Supercomputing

Microsoft Reveals Its First Quantum Computing Chip, the Majorana 1 (cnbc.com) 31

After two decades of quantum computing research, Microsoft has unveiled its first quantum chip: the Majorana 1. CNBC reports: Microsoft's quantum chip employs eight topological qubits using indium arsenide, which is a semiconductor, and aluminum, which is a superconductor. A new paper in the journal Nature describes the chip in detail. Microsoft won't be allowing clients to use its Majorana 1 chip through the company's Azure public cloud, as it plans to do with its custom artificial intelligence chip, Maia 100. Instead, Majorana 1 is a step toward a goal of a million qubits on a chip, following extensive physics research.

Rather than rely on Taiwan Semiconductor or another company for fabrication, Microsoft is manufacturing the components of Majorana 1 itself in the U.S. That's possible because the work is unfolding at a small scale. "We want to get to a few hundred qubits before we start talking about commercial reliability," Jason Zander, a Microsoft executive vice president, told CNBC. In the meantime, the company will engage with national laboratories and universities on research using Majorana 1.

HP

All of Humane's AI Pins Will Stop Working in 10 Days 64

AI hardware startup Humane -- which has been acquired by HP -- has given its users just ten days notice that their Pins will be disconnected. From a report: In a note to its customers, the company said AI Pins will "continue to function normally" until 12PM PT on February 28. On that date, users will lose access to essentially all of their device's features, including but not limited to calling, messaging, AI queries and cloud access. The FAQ does note that you'll still be able to check on your battery life, though.

Humane is encouraging its users to download any stored data before February 28, as it plans on permanently deleting "all remaining customer data" at the same time as switching its servers off.
United Kingdom

Apple Says UK Regulator's Remedy Options on Mobile Browsers Will Hit Innovation (reuters.com) 34

Apple has told Britain's competition regulator that some of the remedy options proposed by the watchdog to address concerns in the mobile browser market would impact the iPhone maker's incentive to innovate. From a report: The responses from Apple and Google to the regulator's investigation in the supply of mobile browsers and browser engines and the distribution of cloud gaming services through app stores on mobile devices in the country were published on the government website on Wednesday.
Microsoft

Microsoft Reminds Admins To Prepare For WSUS Driver Sync Deprecation (bleepingcomputer.com) 35

Microsoft is reminding IT administrators that WSUS driver synchronization will be deprecated on April 18, 2025, urging them to transition to cloud-based update solutions like Windows Autopatch, Azure Update Manager, and Microsoft Intune. "For on-premises contexts, drivers will be available on the Microsoft Update catalog, but you won't be able to import them into WSUS," the company said in a Windows message center update on Tuesday. "You'll need to use any of the available alternative solutions, such as Device Driver Packages, or transition to cloud-based driver services for your organization, such as Microsoft Intune and Windows Autopatch." BleepingComputer reports: This reminder follows two other warnings issued since June 2024, announcing the deprecation of WSUS driver synchronization and encouraging customers to adopt Redmond's newer cloud-based driver services. The company also revealed in September 2024 that WSUS had been deprecated, but Microsoft added that it plans to keep publishing updates through the channel and maintain all existing capabilities. This announcement came after WSUS was listed on August 13 as one of the "features removed or no longer developed starting with Windows Server 2025."

"Specifically, this means that we are no longer investing in new capabilities, nor are we accepting new feature requests for WSUS," Microsoft's Nir Froimovici said at the time. "However, we are preserving current functionality and will continue to publish updates through the WSUS channel. We will also support any content already published through the WSUS channel."

AI

HP To Acquire Parts of Humane, Shut Down the AI Pin 51

An anonymous reader quotes a report from Bloomberg: HP will acquire assets from Humane, the maker of a wearable Ai Pin introduced in late 2023, for $116 million. The deal will include the majority of Humane's employees in addition to its software platform and intellectual property, the company said Tuesday. It will not include Humane's Ai pin device business, which will be wound down, an HP spokesperson said. Humane's team, including founders Imran Chaudhri and Bethany Bongiorno, will form a new division at HP to help integrate artificial intelligence into the company's personal computers, printers and connected conference rooms, said Tuan Tran, who leads HP's AI initiatives. Chaudhri and Bongiorno were design and software engineers at Apple before founding the startup. [...]

Tran said he was particularly impressed with aspects of Humane's design, such as the ability to orchestrate AI models running both on-device and in the cloud. The deal is expected to close at the end of the month, HP said. "There will be a time and place for pure AI devices," Tran said. "But there is going to be AI in all our devices -- that's how we can help our business customers be more productive."
Businesses

When a Lifetime Subscription Can Save You Money - and When It's Risky (msn.com) 25

Apps offering lifetime subscriptions may pose risks despite potential cost savings, according to cybersecurity experts and analysts. While some lifetime plans can pay off quickly - like dating app Bumble's $300 premium subscription that breaks even in five months - others require years of use to justify hefty upfront costs. Meditation app Waking Up charges $1,500 for lifetime access, requiring over 11 years of use to recoup the investment.

Security researchers warn against lifetime subscriptions for services with high recurring costs like VPNs and cloud storage. Such providers may compromise user privacy or cut corners on infrastructure to offset losses, said Trevor Hilligoss, senior vice president at cybercrime research group SpyCloud Labs.
Privacy

Nearly 10 Years After Data and Goliath, Bruce Schneier Says: Privacy's Still Screwed (theregister.com) 57

Ten years after publishing his influential book on data privacy, security expert Bruce Schneier warns that surveillance has only intensified, with both government agencies and corporations collecting more personal information than ever before. "Nothing has changed since 2015," Schneier told The Register in an interview. "The NSA and their counterparts around the world are still engaging in bulk surveillance to the extent of their abilities."

The widespread adoption of cloud services, Internet-of-Things devices, and smartphones has made it nearly impossible for individuals to protect their privacy, said Schneier. Even Apple, which markets itself as privacy-focused, faces limitations when its Chinese business interests are at stake. While some regulation has emerged, including Europe's General Data Protection Regulation and various U.S. state laws, Schneier argues these measures fail to address the core issue of surveillance capitalism's entrenchment as a business model.

The rise of AI poses new challenges, potentially undermining recent privacy gains like end-to-end encryption. As AI assistants require cloud computing power to process personal data, users may have to surrender more information to tech companies. Despite the grim short-term outlook, Schneier remains cautiously optimistic about privacy's long-term future, predicting that current surveillance practices will eventually be viewed as unethical as sweatshops are today. However, he acknowledges this transformation could take 50 years or more.
AI

PIN AI Launches Mobile App Letting You Make Your Own Personalized, Private AI Model (venturebeat.com) 13

An anonymous reader quotes a report from VentureBeat: A new startup PIN AI (not to be confused with the poorly reviewed hardware device the AI Pin by Humane) has emerged from stealth to launch its first mobile app, which lets a user select an underlying open-source AI model that runs directly on their smartphone (iOS/Apple iPhone and Google Android supported) and remains private and totally customized to their preferences. Built with a decentralized infrastructure that prioritizes privacy, PIN AI aims to challenge big tech's dominance over user data by ensuring that personal AI serves individuals -- not corporate interests. Founded by AI and blockchain experts from Columbia, MIT and Stanford, PIN AI is led by Davide Crapis, Ben Wu and Bill Sun, who bring deep experience in AI research, large-scale data infrastructure and blockchain security. [...]

PIN AI introduces an alternative to centralized AI models that collect and monetize user data. Unlike cloud-based AI controlled by large tech firms, PIN AI's personal AI runs locally on user devices, allowing for secure, customized AI experiences without third-party surveillance. At the heart of PIN AI is a user-controlled data bank, which enables individuals to store and manage their personal information while allowing developers access to anonymized, multi-category insights -- ranging from shopping habits to investment strategies. This approach ensures that AI-powered services can benefit from high-quality contextual data without compromising user privacy. [...] The new mobile app launched in the U.S. and multiple regions also includes key features such as:

- The "God model" (guardian of data): Helps users track how well their AI understands them, ensuring it aligns with their preferences.
- Ask PIN AI: A personalized AI assistant capable of handling tasks like financial planning, travel coordination and product recommendations.
- Open-source integrations: Users can connect apps like Gmail, social media platforms and financial services to their personal AI, training it to better serve them without exposing data to third parties.
- "With our app, you have a personal AI that is your model," Crapis added. "You own the weights, and it's completely private, with privacy-preserving fine-tuning."
Davide Crapis, co-founder of PIN AI, told VentureBeat that the app currently supports several open-source AI models, including small versions of DeepSeek and Meta's Llama. "With our app, you have a personal AI that is your model," Crapis added. "You own the weights, and it's completely private, with privacy-preserving fine-tuning."

You can sign up for early access to the PIN AI app here.
Data Storage

Western Digital Aims For 100TB Hard Drives by 2030 (tomshardware.com) 63

Western Digital plans to introduce its first heat-assisted magnetic recording (HAMR) drives in late 2026, with 36TB conventional magnetic recording (CMR) and 44TB shingled UltraSMR variants. Volume production won't begin until the first half of 2027, following qualification by cloud data center providers in late 2026.

The company projects that HAMR technology, combined with OptiNAND, increased platter count, and mechanical improvements, will enable drives reaching 80TB CMR and 100TB UltraSMR capacities around 2030 -- a departure from Western Digital's previous commitment to microwave-assisted magnetic recording (MAMR) in 2017, which evolved into the energy-assisted perpendicular magnetic recording (ePMR) technology used in current drives.
The Military

Anduril To Take Over Managing Microsoft Goggles for US Army (msn.com) 21

Anduril will take over management and eventual manufacturing of the U.S. Army's Integrated Visual Augmentation System (IVAS) from Microsoft, a significant shift in one of the military's most ambitious augmented reality projects.

The deal, which requires Army approval, could be worth over $20 billion in the next decade if all options are exercised, according to Bloomberg. The IVAS system, based on Microsoft's HoloLens mixed reality platform, aims to equip soldiers with advanced capabilities including night vision and airborne threat detection.

Under the new arrangement, Microsoft will transition to providing cloud computing and AI infrastructure, while Anduril assumes control of hardware production and software development. The Army has planned orders for up to 121,000 units, though full production hinges on passing combat testing this year.

The program has faced technical hurdles, with early prototypes causing headaches and nausea among soldiers. The current slimmer version has received better feedback, though cost remains a concern - the Army indicated the $80,000 per-unit price needs to "be substantially less" to justify large-scale procurement.

Anduril founder Palmer Luckey, writing in a blog post: This move has been so many years in the making, over a decade of hacking and scheming and dreaming and building with exactly this specific outcome clearly visualized in my mind's eye. I can hardly believe I managed to pull it off. Everything I've done in my career -- building Oculus out of a camper trailer, shipping VR to millions of consumers, getting run out of Silicon Valley by backstabbing snakes, betting that Anduril could tear people out of the bigtech megacorp matrix and put them to work on our nation's most important problems -- has led to this moment. IVAS isn't just another product, it is a once-in-a-generation opportunity to redefine how technology supports those who serve. We have a shot to prove that this long-standing dream is no windmill, that this can expand far beyond one company or one headset and act as a a nexus for the best of the best to set a new standard for how a large collection of companies can work together to solve our nation's most important problems.
Open Source

Does the 'Spirit' of Open Source Mean Much More Than a License? (techcrunch.com) 58

"Open source can be something of an illusion," writes TechCrunch. "A lack of real independence can mean a lack of agency for those who would like to properly get involved in a project."
Their article makes the case that the "spirit" of open source means more than a license... "Android, in a license sense, is perhaps the most well-documented, perfectly open 'thing' that there is," Luis Villa, co-founder and general counsel at Tidelift, said in a panel discussion at the State of Open Con25 in London this week. "All the licenses are exactly as you want them — but good luck getting a patch into that, and good luck figuring out when the next release even is...."

"If you think about the practical accessibility of open source, it goes beyond the license, right?" Peter Zaitsev, founder of open source database services company Percona, said in the panel discussion. "Governance is very important, because if it's a single corporation, they can change a license like 'that.'" These sentiments were echoed in a separate talk by Dotan Horovits, open source evangelist at the Cloud Native Computing Foundation (CNCF), where he mused about open source "turning to the dark side." He noted that in most cases, issues arise when a single-vendor project decides to make changes based on its own business needs among other pressures. "Which begs the question, is vendor-owned open source an oxymoron?" Horovits said. "I've been asking this question for a good few years, and in 2025 this question is more relevant than ever."

The article adds that in 2025, "These debates won't be going anywhere anytime soon, as open source has emerged as a major focal point in the AI realm." And it includes this quote from Tidelift's co-founder.

"I have my quibbles and concerns about the open source AI definition, but it's really clear that what Llama is doing isn't open source," Villa said. Emily Omier, a consultant for open source businesses and host of the Business of Open Source podcast, added that such attempts to "corrupt" the meaning behind "open source" is testament to its inherent power.

Much of this may be for regulatory reasons, however. The EU AI Act has a special carve-out for "free and open source" AI systems (aside from those deemed to pose an "unacceptable risk"). And Villa says this goes some way toward explaining why a company might want to rewrite the rulebook on what "open source" actually means. "There are plenty of actors right now who, because of the brand equity [of open source] and the regulatory implications, want to change the definition, and that's terrible," Villa said.

AI

DeepSeek IOS App Sends Data Unencrypted To ByteDance-Controlled Servers (arstechnica.com) 68

An anonymous Slashdot reader quotes a new article from Ars Technica: On Thursday, mobile security company NowSecure reported that [DeepSeek] sends sensitive data over unencrypted channels, making the data readable to anyone who can monitor the traffic. More sophisticated attackers could also tamper with the data while it's in transit. Apple strongly encourages iPhone and iPad developers to enforce encryption of data sent over the wire using ATS (App Transport Security). For unknown reasons, that protection is globally disabled in the app, NowSecure said. What's more, the data is sent to servers that are controlled by ByteDance, the Chinese company that owns TikTok...

[DeepSeek] is "not equipped or willing to provide basic security protections of your data and identity," NowSecure co-founder Andrew Hoog told Ars. "There are fundamental security practices that are not being observed, either intentionally or unintentionally. In the end, it puts your and your company's data and identity at risk...." This data, along with a mix of other encrypted information, is sent to DeepSeek over infrastructure provided by Volcengine a cloud platform developed by ByteDance. While the IP address the app connects to geo-locates to the US and is owned by US-based telecom Level 3 Communications, the DeepSeek privacy policy makes clear that the company "store[s] the data we collect in secure servers located in the People's Republic of China...."

US lawmakers began pushing to immediately ban DeepSeek from all government devices, citing national security concerns that the Chinese Communist Party may have built a backdoor into the service to access Americans' sensitive private data. If passed, DeepSeek could be banned within 60 days.

Google

Google Pulls Incorrect Gouda Stat From Its AI Super Bowl Ad (theverge.com) 51

An anonymous reader shares a report: Google has edited Gemini's AI response in a Super Bowl commercial to remove an incorrect statistic about cheese. The ad, which shows a small business owner using Gemini to write a website description about Gouda, no longer says the variety makes up "50 to 60 percent of the world's cheese consumption."

In the edited YouTube video, Gemini's response now skips over the specifics and says Gouda is "one of the most popular cheeses in the world." Google Cloud apps president Jerry Dischler initially defended the response, saying on X it's "grounded in the Web" and "not a hallucination."

Encryption

UK Orders Apple To Let It Spy on Users' Encrypted Accounts (msn.com) 96

The UK government has ordered Apple to create a backdoor allowing access to encrypted cloud backups of users worldwide, Washington Post reported Friday, citing multiple sources familiar with the matter. The unprecedented demand, issued last month through a technical capability notice under the UK Investigatory Powers Act, requires Apple to provide blanket access to fully encrypted material rather than assistance with specific accounts.

Apple is likely to discontinue its encrypted storage service in the UK rather than compromise user security globally, the report said. The company would still face pressure to provide backdoor access for users in other countries, including the United States. The order was issued under Britain's 2016 Investigatory Powers Act, which makes it illegal to disclose such government demands, according to the report. While Apple can appeal to a secret technical panel and judge, the law requires compliance during any appeal process. The company told Parliament in March that the UK government should not have authority to decide whether global users can access end-to-end encryption.
AI

Researchers Created an Open Rival To OpenAI's o1 'Reasoning' Model for Under $50 23

AI researchers at Stanford and the University of Washington were able to train an AI "reasoning" model for under $50 in cloud compute credits, according to a research paper. From a report: The model, known as s1, performs similarly to cutting-edge reasoning models, such as OpenAI's o1 and DeepSeek's R1, on tests measuring math and coding abilities. The s1 model is available on GitHub, along with the data and code used to train it.

The team behind s1 said they started with an off-the-shelf base model, then fine-tuned it through distillation, a process to extract the "reasoning" capabilities from another AI model by training on its answers. The researchers said s1 is distilled from one of Google's reasoning models, Gemini 2.0 Flash Thinking Experimental. Distillation is the same approach Berkeley researchers used to create an AI reasoning model for around $450 last month.
Windows

Microsoft's Windows 10 Extended Security Updates Will Start at $61 per PC for Businesses 70

Microsoft will charge commercial customers $61 per device in the first year to continue receiving Windows 10 security updates after support ends, The Register wrote in a PSA note Wednesday, citing text, with costs doubling each subsequent year for up to three years.

Organizations can't skip initial years to save money, as the updates are cumulative. Some users may avoid fees if they connect Windows 10 endpoints to Windows 365 Cloud PCs. The program also covers Windows 10 virtual machines running on Windows 365 or Azure Virtual Desktop for three years with an active Windows 365 subscription.
Transportation

UK Team Invents Self-Healing Road Surface To Prevent Potholes (theguardian.com) 34

An anonymous reader quotes a report from The Guardian: For all motorists, but perhaps the Ferrari-collecting rocker Rod Stewart in particular, it will be music to the ears: researchers have developed a road surface that heals when it cracks, preventing potholes without a need for human intervention. The international team devised a self-healing bitumen that mends cracks as they form by fusing the asphalt back together. In laboratory tests, pieces of the material repaired small fractures within an hour of them first appearing. "When you close the cracks you prevent potholes forming in the future and extend the lifespan of the road," said Dr Jose Norambuena-Contreras, a researcher on the project at Swansea University. "We can extend the surface lifespan by 30%."

Potholes typically start from small surface cracks that form under the weight of traffic. These allow water to seep into the road surface, where it causes more damage through cycles of freezing and thawing. Bitumen, the sticky black substance used in asphalt, becomes susceptible to cracking when it hardens through oxidation. To make the self-healing bitumen, the researchers mixed in tiny porous plant spores soaked in recycled oils. When the road surface is compressed by passing traffic, it squeezes the spores, which release their oil into any nearby cracks. The oils soften the bitumen enough for it to flow and seal the cracks. Working with researchers at King's College London and Google Cloud, the scientists used machine learning, a form of artificial intelligence, to model the movement of organic molecules in bitumen and simulate the behaviour of the self-healing material to see how it responded to newly formed cracks. The material could be scaled up for use on British roads in a couple of years, the researchers believe.
Google published a blog post with more information about the "self-healing" asphalt.
The Military

Air Force Documents On Gen AI Test Are Just Whole Pages of Redactions 12

An anonymous reader quotes a report from 404 Media: The Air Force Research Laboratory (AFRL), whose tagline is "Win the Fight," has paid more than a hundred thousand dollars to a company that is providing generative AI services to other parts of the Department of Defense. But the AFRL refused to say what exactly the point of the research was, and provided page after page of entirely blacked out, redacted documents in response to a Freedom of Information Act (FOIA) request from 404 Media related to the contract. [...] "Ask Sage: Generative AI Acquisition Accelerator," a December 2023 procurement record reads, with no additional information on the intended use case. The Air Force paid $109,490 to Ask Sage, the record says.

Ask Sage is a company focused on providing generative AI to the government. In September the company announced that the Army was implementing Ask Sage's tools. In October it achieved "IL5" authorization, a DoD term for the necessary steps to protect unclassified information to a certain standard. 404 Media made an account on the Ask Sage website. After logging in, the site presents a list of the models available through Ask Sage. Essentially, they include every major model made by well-known AI companies and open source ones. Open AI's GPT-4o and DALL-E-3; Anthropic's Claude 3.5; and Google's Gemini are all included. The company also recently added the Chinese-developed DeepSeek R1, but includes a disclaimer. "WARNING. DO NOT USE THIS MODEL WITH SENSITIVE DATA. THIS MODEL IS BIASED, WITH TIES TO THE CCP [Chinese Communist Party]," it reads. Ask Sage is a way for government employees to access and use AI models in a more secure way. But only some of the models in the tool are listed by Ask Sage as being "compliant" with or "capable" of handling sensitive data.

[...] [T]he Air Force declined to provide any real specifics on what it paid Ask Sage for. 404 Media requested all procurement records related to the Ask Sage contract. Instead, the Air Force provided a 19 page presentation which seemingly would have explained the purpose of the test, while redacting 18 of the pages. The only available page said "Ask Sage, Inc. will explore the utilization of Ask Sage by acquisition Airmen with the DAF for Innovative Defense-Related Dual Purpose Technologies relating to the mission of exploring LLMs for DAF use while exploring anticipated benefits, clearly define needed solution adaptations, and define clear milestones and acceptance criteria for Phase II efforts."
Intel

Intel Won't Bring Its Falcon Shores AI Chip To Market (techcrunch.com) 24

During the company's fourth-quarter earnings call Thursday, Intel co-CEO Michelle Johnston Holthaus announced that Intel has decided to cancel its Falcon Shores AI chip. Instead, it'll opt to use it as an internal test chip while shifting focus to Jaguar Shores for AI data center solutions. TechCrunch reports: "AI data center ... is an attractive market for us," Holthaus said during the call. "[B]ut I am not happy with where we are today. We're not yet participating in the cloud-based AI data center market in a meaningful way ... One of the immediate actions I have taken is to simplify our roadmap and concentrate our resources." The focus instead will be on Jaguar Shores, which Holthaus called Intel's opportunity to "develop a system-level solution at rack scale ... to address the AI data center more broadly."

Holthaus tempered expectations for Falcon Shores last month, when she implied that it was an "iterative" step over the company's previous dedicated AI data center chip, Gaudi 3. "One of the things that we've learned from Gaudi is, it's not enough to just deliver the silicon," Holthaus said during Thursday's earnings call. "Falcon Shores will help us in that process of working on the system, networking, memory -- all those component[s]. But what customers really want is that full-scale rack solution, and so we're able to get to that with Jaguar Shores."

"As I think about our AI opportunity, my focus is on the problems our customers are trying to solve, most notably the need to lower the cost and increase the efficiency of compute," Holthaus said. "As such, a one-size-fits-all approach will not work, and I can see clear opportunities to leverage our core assets in new ways to drive the most compelling total cost of ownership across the continuum."

Data Storage

Archivists Work To Identify and Save the Thousands of Datasets Disappearing From Data.gov (404media.co) 70

An anonymous reader quotes a report from 404 Media: Datasets aggregated on data.gov, the largest repository of U.S. government open data on the internet, are being deleted, according to the website's own information. Since Donald Trump was inaugurated as president, more than 2,000 datasets have disappeared from the database. As people in the Data Hoarding and archiving communities have pointed out, on January 21, there were 307,854 datasets on data.gov. As of Thursday, there are 305,564 datasets. Many of the deletions happened immediately after Trump was inaugurated, according to snapshots of the website saved on the Internet Archive's Wayback Machine. Harvard University researcher Jack Cushman has been taking snapshots of Data.gov's datasets both before and after the inauguration, and has worked to create a full archive of the data.

"Some of [the entries link to] actual data," Cushman told 404 Media. "And some of them link to a landing page [where the data is hosted]. And the question is -- when things are disappearing, is it the data it points to that is gone? Or is it just the index to it that's gone?" For example, "National Coral Reef Monitoring Program: Water Temperature Data from Subsurface Temperature Recorders (STRs) deployed at coral reef sites in the Hawaiian Archipelago from 2005 to 2019," a NOAA dataset, can no longer be found on data.gov but can be found on one of NOAA's websites by Googling the title. "Stetson Flower Garden Banks Benthic_Covage Monitoring 1993-2018 -- OBIS Event," another NOAA dataset, can no longer be found on data.gov and also appears to have been deleted from the internet. "Three Dimensional Thermal Model of Newberry Volcano, Oregon," a Department of Energy resource, is no longer available via the Department of Energy but can be found backed up on third-party websites. [...]

Data.gov serves as an aggregator of datasets and research across the entire government, meaning it isn't a single database. This makes it slightly harder to archive than any individual database, according to Mark Phillips, a University of Northern Texas researcher who works on the End of Term Web Archive, a project that archives as much as possible from government websites before a new administration takes over. "Some of this falls into the 'We don't know what we don't know,'" Phillips told 404 Media. "It is very challenging to know exactly what, where, how often it changes, and what is new, gone, or going to move. Saving content from an aggregator like data.gov is a bit more challenging for the End of Term work because often the data is only identified and registered as a metadata record with data.gov but the actual data could live on another website, a state .gov, a university website, cloud provider like Amazon or Microsoft or any other location. This makes the crawling even more difficult."

Phillips said that, for this round of archiving (which the team does every administration change), the project has been crawling government websites since January 2024, and that they have been doing "large-scale crawls with help from our partners at the Internet Archive, Common Crawl, and the University of North Texas. We've worked to collect 100s of terabytes of web content, which includes datasets from domains like data.gov." [...] It is absolutely true that the Trump administration is deleting government data and research and is making it harder to access. But determining what is gone, where it went, whether it's been preserved somewhere, and why it was taken down is a process that is time intensive and going to take a while. "One thing that is clear to me about datasets coming down from data.gov is that when we rely on one place for collecting, hosting, and making available these datasets, we will always have an issue with data disappearing," Phillips said. "Historically the federal government would distribute information to libraries across the country to provide greater access and also a safeguard against loss. That isn't done in the same way for this government data."

Slashdot Top Deals