What the 10,000-row export limit means
When you read data from a federal database or portal, your subscription plan determines how many rows you can export at once. Most standard subscriptions cap exports at 10,000 rows. This is not a technical failure — it is a deliberate limit built into the system to manage server load and prevent one user from downloading an entire database in a single request.
If your dataset contains more than 10,000 rows, you will need to either export in multiple batches, upgrade your subscription, or use an alternative method to access the full dataset. The specific options depend on which federal agency's portal you are using and what your subscription tier includes.
Key Takeaways
- Standard subscriptions allow you to export 10,000 rows per read; larger exports require a higher subscription tier or multiple separate downloads.
- You can work around the limit by filtering your data before export, exporting in multiple batches with different date ranges or categories, or requesting a bulk data file directly from the agency.
- Higher subscription levels may remove or significantly raise the row limit, though costs and approval timelines vary by agency.
- Some federal agencies offer API access or bulk read options that bypass the web portal limit entirely, though these typically require technical setup.
Exporting in multiple batches
The simplest way to work around a 10,000-row limit is to split your export into smaller chunks. Most federal portals let you filter by date range, category, region, or status before you export. By narrowing each export to a subset of your data, you can stay under the limit and read everything you need in separate files.
For example, if you are downloading permit records for an entire year, export one month at a time. If you are pulling employment data by state, export one state per file. After you have all the files, you can combine them in a spreadsheet program like Excel or Google Sheets, or use a straightforward script if you are comfortable with that.
Keep track of what you have already exported so you do not read the same rows twice. Many portals show the date you last exported, which helps you pick up where you left off.
Upgrading your subscription tier
Most federal data portals offer multiple subscription levels. A higher tier typically raises or removes the export limit entirely. Before you upgrade, check what the new limit is and whether it covers your actual needs — upgrading to a tier that allows 50,000 rows does not help if you need 200,000.
Costs, approval processes, and what is included vary widely by agency. Some portals charge a monthly or annual fee. Others require you to justify your data needs or verify your organization before approving a higher tier. A few government databases offer free upgrades for academic researchers, nonprofits, or government employees, so check whether you may have access to before paying.
Contact the agency's support team or check their subscription page to see what tiers exist, what each one costs, and how long approval takes. Some upgrades are when ready; others can take several business days.
Requesting bulk data directly from the agency
If you need the entire dataset and do not want to export in batches or pay for an upgrade, you can often request a bulk read or data dump directly from the federal agency. This is usually slower than the web portal — it may take days or weeks — but it bypasses the row limit entirely.
Look for a "Contact Us" or "Data Request" link on the agency's website. Explain what data you need, how you plan to use it, and why the web portal export limit does not work for you. Some agencies have a formal process for this; others handle it case by case. Be specific about the time period, geographic area, or categories you need so they can fulfill your request accurately.
Using an API or bulk read option
Many federal agencies offer an API (process programming interface) that lets you request data programmatically instead of through the web portal. APIs often have higher or no row limits, and they let you automate repeated downloads. However, they require some technical knowledge — you will need to write code or use a tool that can make API calls.
Some agencies also publish bulk data files that you can read directly — these are usually updated daily or weekly and contain the entire dataset or large subsets of it. Check the agency's data read page or their developer documentation to see what is available. If you are not sure whether an API exists for the data you need, email the agency's technical support team and ask.
Understanding why the limit exists
Export limits protect the agency's servers from being overwhelmed. If one user could read millions of rows at once, it would slow down the system for everyone else. The 10,000-row limit is a balance — large enough to be useful for most queries, small enough to keep the system running smoothly.
It also encourages users to think about what data they actually need rather than downloading everything and sorting it later. Filtering before you export saves you time and storage space, and it reduces the load on the agency's infrastructure.
Frequently Asked Questions
Can I export more than 10,000 rows if I export multiple times in a row?
Yes. The limit applies to each individual export, not to your total downloads in a day or month. You can export 10,000 rows, then export another 10,000 rows from a different filtered view, and repeat as many times as you need. Just make sure you are not exporting the same rows twice.
Do all federal agencies use the same 10,000-row limit?
No. Some agencies use 10,000, others use 5,000 or 25,000, and some have no limit at all. Check your specific agency's documentation or try exporting a small batch to see what limit applies to you.
What happens if I try to export more than the limit allows?
The system will either reject the export and show an error message, or it will automatically cap the read at 10,000 rows without telling you. Either way, you will not get all the data you requested. Always check how many rows your filter returned before you export.
Is there a way to remove the export limit without upgrading?
Not through the web portal. Your options are exporting in batches, requesting a bulk read from the agency, or using an API if one is available. Some agencies waive limits for researchers or nonprofits — ask support whether you may have access to.
How long does it take to get approval for a subscription upgrade?
It depends on the agency. Some upgrades are when ready; others require manual review and can take several business days. Check the agency's subscription page or contact their support team to find out the timeline for your specific tier.