A User'S Guide To The International Hapmap Project Web Site: Fill & Download for Free

You can find lists of datasets in Github.This can however be hard to find just by searching on Github, so I would usually start by searching on Google.A Google search could look something like this:YOUR INDUSTRY intitle:datasetORYOUR INDUSTRY inurl:datasetFor Machine Learning competitions they also usually provide access to large datasets.See kaggle.com for Machine Learning / Data Science competitions and related datasets.For a start I found a list of datasets on Github, you can use.Here is a huge list of datasetsThis list of public data sources are collected and tidied from blogs, answers, and user responses. Most of the data sets listed below are free, however, some are not. Other amazingly awesome lists can be found in the awesome-awesomeness and sindresorhus's awesome list.The list is copied from Github repo: caesar0301/awesome-public-datasetsAgricultureU.S. Department of Agriculture's PLANTS DatabaseU.S. Department of Agriculture's Nutrient DatabaseBiology1000 GenomesAmerican Gut (Microbiome Project)Broad Bioimage Benchmark Collection (BBBC)Broad Cancer Cell Line Encyclopedia (CCLE)Cell Image LibraryComplete Genomics Public DataEBI ArrayExpressEBI Protein Data Bank in EuropeElectron Microscopy Pilot Image Archive (EMPIAR)ENCODE projectEnsembl GenomesGene Expression Omnibus (GEO)Gene Ontology (GO)Global Biotic Interactions (GloBI)Harvard Medical School (HMS) LINCS ProjectHuman Genome Diversity ProjectHuman Microbiome Project (HMP)ICOS PSP BenchmarkInternational HapMap ProjectJournal of Cell Biology DataViewerMIT Cancer Genomics DataNCBI ProteinsNCBI TaxonomyNCI Genomic Data CommonsNIH Microarray data or FTP (see FTP link on RAW)OpenSNP genotypes dataPathguid - Protein-Protein Interactions CatalogProtein Data BankPsychiatric Genomics ConsortiumPubChem ProjectPubGene (now Coremine Medical)Sanger Catalogue of Somatic Mutations in Cancer (COSMIC)Sanger Genomics of Drug Sensitivity in Cancer Project (GDSC)Sequence Read Archive(SRA)Stanford Microarray DataStowers Institute Original Data RepositorySystems Science of Biological Dynamics (SSBD) DatabaseThe Cancer Genome Atlas (TCGA), available via Broad GDACThe Catalogue of LifeThe Personal Genome Project or PGPUCSC Public DataUniGeneUniversal Protein Resource (UnitProt)Climate/WeatherActuaries Climate IndexAustralian WeatherAviation Weather Center - Consistent, timely and accurate weather information for the world airspace systemBrazilian Weather - Historical data (In Portuguese)Canadian Meteorological CentreClimate Data from UEA (updated monthly)European Climate Assessment & DatasetGlobal Climate Data Since 1929NASA Global Imagery Browse ServicesNOAA Bering Sea ClimateNOAA Climate DatasetsNOAA Realtime Weather ModelsNOAA SURFRAD Meteorology and Radiation DatasetsThe World Bank Open Data Resources for Climate ChangeUEA Climatic Research UnitWorldClim - Global Climate DataWU Historical Weather WorldwideComplex NetworksAMiner Citation Network DatasetCrossRef DOI URLsDBLP Citation datasetDIMACS Road Networks CollectionNBER Patent CitationsNetwork Repository with Interactive Exploratory Analysis ToolsNIST complex networks data collectionProtein-protein interaction networkPyPI and Maven Dependency NetworkScopus Citation DatabaseSmall Network DataStanford GraphBase (Steven Skiena)Stanford Large Network Dataset CollectionStanford Longitudinal Network Data SourcesThe Koblenz Network CollectionThe Laboratory for Web Algorithmics (UNIMI)The Nexus Network RepositoryUCI Network Data RepositoryUFL sparse matrix collectionWSU Graph DatabaseComputer Networks3.5B Web Pages from CommonCrawl 201253.5B Web clicks of 100K users in Indiana Univ.CAIDA Internet DatasetsClueWeb09 - 1B web pagesClueWeb12 - 733M web pagesCommonCrawl Web Data over 7 yearsCRAWDAD Wireless datasets from Dartmouth Univ.Criteo click-through dataOONI: Open Observatory of Network Interference - Internet censorship dataOpen Mobile Data by MobiPerfRapid7 Sonar Internet ScansUCSD Network Telescope, IPv4 /8 netData ChallengesBruteforce DatabaseChallenges in Machine LearningCrowdANALYTIX dataXD4D Challenge of OrangeDrivenData Competitions for Social GoodICWSM Data Challenge (since 2009)Kaggle Competition DataKDD Cup by Tencent 2012Localytics Data Visualization ChallengeNetflix PrizeSpace Apps ChallengeTelecom Italia Big Data ChallengeTravisTorrent Dataset - MSR'2017 Mining ChallengeYelp Dataset ChallengeEarth ScienceAQUASTAT - Global water resources and usesBODC - marine data of ~22K varsEarth ModelsEOSDIS - NASA's earth observing system dataIntegrated Marine Observing System (IMOS) - roughly 30TB of ocean measurements or on S3Marinexplore - Open Oceanographic DataSmithsonian Institution Global Volcano and Eruption DatabaseUSGS Earthquake ArchivesEconomicsAmerican Economic Association (AEA)EconData from UMDEconomic Freedom of the World DataHistorical MacroEconomc StatisticsInternational Economics Database and various data toolsInternational Trade StatisticsInternet Product Code DatabaseJoint External Debt Data HubJon Haveman International Trade Data LinksOpenCorporates Database of Companies in the WorldOur World in DataSciencesPo World Trade Gravity DatasetsThe Atlas of Economic ComplexityThe Center for International DataThe Observatory of Economic ComplexityUN Commodity Trade StatisticsUN Human Development ReportsEducationCollege Scorecard DataStudent Data from Free Code CampEnergyAMPdsBLUEdCOMBEDDataportDREDECOEIAHES - Household Electricity Study, UKHFEDiAWEPLAID - the Plug Load Appliance Identification DatasetREDDTracebaseUK-DALE - UK Domestic Appliance-Level ElectricityWHITEDFinanceCBOE Futures ExchangeGoogle FinanceGoogle TrendsNASDAQNYSE Market Data (see FTP link on RAW)OANDAOSU Financial dataQuandlSt Louis FederalYahoo FinanceGISArcGIS Open Data portalCambridge, MA, US, GIS data on GitHubFactual Global Location DataGeo Spatial Data from ASUGeo Wiki Project - Citizen-driven Environmental MonitoringGeoFabrik - OSM data extracted to a variety of formats and areasGeoNames WorldwideGlobal Administrative Areas Database (GADM)Homeland Infrastructure Foundation-Level DataLandsat 8 on AWSList of all countries in all languagesNational Weather Service GIS Data PortalNatural Earth - vectors and rasters of the worldOpenAddressesOpenStreetMap (OSM)Pleiades - Gazetteer and graph of ancient placesReverse Geocoder using OSM data & additional high-resolution data filesTIGER/Line - U.S. boundaries and roadsTwoFishes - Foursquare's coarse geocoderTZ Timezones shapfilesUN Environmental DataWorld boundaries from the U.S. Department of StateWorld countries in multiple formatsGovernmentA list of cities and countries contributed by communityOpen Data for AfricaOpenDataSoft's list of 1,600 open dataHealthcareEHDP Large Health Data SetsGapminder World demographic databasesMedicare Coverage Database (MCD), U.S.Medicare Data Engine of medicare.gov DataMedicare Data FileMeSH, the vocabulary thesaurus used for indexing articles for PubMedNumber of Ebola Cases and Deaths in Affected Countries (2014)Open-ODS (structure of the UK NHS)OpenPaymentsData, Healthcare financial relationship dataThe Cancer Genome Atlas project (TCGA) and BigQuery tableWorld Health Organization Global Health ObservatoryImage Processing10k US Adult Faces Database2GB of Photos of Cats or Archive versionAdience Unfiltered faces for gender and age classificationAffective Image ClassificationAnimals with attributesCaltech Pedestrian Detection BenchmarkChars74K dataset, Character Recognition in Natural Images (both English and Kannada are available)Face Recognition BenchmarkGDXray: X-ray images for X-ray testing and Computer VisionImageNet (in WordNet hierarchy)Indoor Scene RecognitionInternational Affective Picture System, UFLMassive Visual Memory Stimuli, MITMNIST database of handwritten digits, near 1 million examplesSeveral Shape-from-Silhouette DatasetsStanford Dogs DatasetSUN database, MITThe Action Similarity Labeling (ASLAN) ChallengeThe Oxford-IIIT Pet DatasetViolent-Flows - Crowd Violence Non-violence Database and benchmarkVisual genomeYouTube Faces DatabaseMachine LearningContext-aware data sets from five domainsDelve Datasets for classification and regression (Univ. of Toronto)Discogs Monthly DataeBay Online Auctions (2012)IMDb DatabaseKeel Repository for classification, regression and time seriesLabeled Faces in the Wild (LFW)Lending Club Loan DataMachine Learning Data Set RepositoryMillion Song DatasetMore Song DatasetsMovieLens Data SetsNew Yorker caption contest ratingsRDataMining - "R and Data Mining" ebook dataRegistered Meteorites on EarthRestaurants Health Score Data in San FranciscoUCI Machine Learning RepositoryYahoo! Ratings and Classification DataYoutube 8mMuseumsCanada Science and Technology Museums Corporation's Open DataCooper-Hewitt's Collection DatabaseMinneapolis Institute of Arts metadataNatural History Museum (London) Data PortalRijksmuseum Historical Art CollectionTate Collection metadataThe Getty vocabulariesNatural LanguageAutomatic Keyphrase ExtracttionBlogger CorpusCLiPS Stylometry Investigation CorpusClueWeb09 FACCClueWeb12 FACCDBpedia - 4.58M things with 583M factsFlickr Personal TaxonomiesFreebase.com of people, places, and thingsGoogle Books Ngrams (2.2TB)Google MC-AFP, generated based on the public available Gigaword dataset using Paragraph VectorsGoogle Web 5gram (1TB, 2006)Gutenberg eBooks ListHansards text chunks of Canadian ParliamentMachine Comprehension Test (MCTest) of text from Microsoft ResearchMachine Translation of European languagesMicrosoft MAchine Reading COmprehension Dataset (or MS MARCO)Multi-Domain Sentiment Dataset (version 2.0)Open Multilingual WordnetPersonae CorpusSaudiNewsNet Collection of Saudi Newspaper Articles (Arabic, 30K articles)SMS Spam Collection in EnglishUniversal DependenciesUSENET postings corpus of 2005~2011Webhose - News/Blogs in multiple languagesWikidata - Wikipedia databasesWikipedia Links data - 40 Million Entities in ContextWordNet databases and toolsNeuroscienceAllen Institute DatasetsBrain CatalogueBrainomicsCodeNeuro DatasetsCollaborative Research in Computational Neuroscience (CRCNS)FCP-INDIHuman Connectome ProjectNDARNeuroDataNeuroelectroNIMH Data ArchiveOASISOpenfMRIStudy ForrestPhysicsCERN Open Data PortalCrystallography Open DatabaseNASA Exoplanet ArchiveNSSDC (NASA) data of 550 space spacecraftSloan Digital Sky Survey (SDSS) - Mapping the UniversePsychology/CognitionOSU Cognitive Modeling Repository DatasetsPublic DomainsAmazonArchive-it from Internet ArchiveArchive.org DatasetsCMU JASA data archiveCMU StatLab collectionsData.WorldData360Datamob.orgGoogleInfochimpsKDNuggets Data CollectionsMicrosoft Azure Data Market Free DataSetsMicrosoft Data Science for ResearchNumbrayOpen Library Data DumpsReddit DatasetsRevolutionAnalytics CollectionSample R data setsStats4Stem R data setsStatSci.orgThe Washington Post ListUCLA SOCR data collectionUFO ReportsWikileaks 911 pager interceptsYahoo WebscopeSearch EnginesAcademic Torrents of data sharing from UMBDatahub.ioDataMarket (Qlik)Harvard Dataverse Network of scientific dataICPSR (UMICH)Institute of Education SciencesNational Technical Reports LibraryOpen Data Certificates (beta)OpenDataNetwork - A search engine of all Socrata powered data portalsStatista.com - statistics and StudiesZenodo - An open dependable home for the long-tail of scienceSocial Networks72 hours #gamergate Twitter ScrapeAncestry.com Forum Dataset over 10 yearsCheng-Caverlee-Lee September 2009 - January 2010 Twitter ScrapeCMU Enron Email of 150 usersEDRM Enron EMail of 151 users, hosted on S3Facebook Data Scrape (2005)Facebook Social Networks from LAW (since 2007)Foursquare from UMN/Sarwat (2013)GitHub Collaboration ArchiveGoogle Scholar citation relationsHigh-Resolution Contact Networks from Wearable SensorsMobile Social Networks from UMASSNetwork Twitter DataReddit CommentsSkytrax' Air Travel Reviews DatasetSocial Twitter DataSourceForge.net Research DataTwitter Data for Online Reputation ManagementTwitter Data for Sentiment AnalysisTwitter Graph of entire Twitter siteTwitter Scrape Calufa May 2011UNIMI/LAW Social Network DatasetsYahoo! Graph and Social DataYoutube Video Social Graph in 2007,2008Social SciencesACLED (Armed Conflict Location & Event Data Project)Canadian Legal Information InstituteCenter for Systemic Peace Datasets - Conflict Trends, Polities, State Fragility, etcCorrelates of War ProjectCryptome Conspiracy Theory ItemsDatacardsEuropean Social SurveyFBI Hate Crime 2013 - aggregated dataFragile States IndexGDELT Global Events DatabaseGeneral Social Survey (GSS) since 1972German Social SurveyGlobal Religious Futures ProjectHumanitarian Data ExchangeINFORM Index for Risk ManagementInstitute for Demographic StudiesInternational Networks ArchiveInternational Social Survey Program ISSPInternational Studies Compendium ProjectJames McGuire Cross National DataMacroData Guide by Norsk samfunnsvitenskapelig datatjenesteMinnesota Population CenterMIT Reality Mining DatasetNotre Dame Global Adaptation Index (NG-DAIN)Open Crime and Policing Data in England, Wales and Northern IrelandPaul Hensel General International Data PagePewResearch Internet Survey ProjectPewResearch Society Data CollectionPolitical Polarity DataStackExchange Data ExplorerTerrorism Research and Analysis ConsortiumTexas Inmates Executed Since 1984Titanic Survival Data Set or on KaggleUCB's Archive of Social Science Data (D-Lab)UCLA Social Sciences Data ArchiveUN Civil Society DatabaseUniversities WorldwideUPJOHN for Labor Employment ResearchUppsala Conflict Data ProgramWorld Bank Open DataWorldPop project - Worldwide human population distributionsSoftwareFLOSSmole data about free, libre, and open source software developmentSportsBasketball (NBA/NCAA/Euro) Player Database and StatisticsBetfair Historical Exchange DataCricsheet Matches (cricket)Ergast Formula 1, from 1950 up to date (API)Football/Soccer resources (data and APIs)Lahman's Baseball DatabasePinhooker: Thoroughbred Bloodstock Sale DataRetrosheet Baseball StatisticsTennis database of rankings, results, and stats for ATP, WTA, Grand Slams and Match Charting ProjectTime SeriesDatabanks International Cross National Time Series Data ArchiveHard Drive Failure RatesHeart Rate Time Series from MITTime Series Data Library (TSDL) from MUUC Riverside Time Series DatasetTransportationAirlines OD Data 1987-2008Bay Area Bike Share DataBike Share Systems (BSS) collectionGeoLife GPS Trajectory from Microsoft ResearchGerman train system by Deutsche BahnHubway Million Rides in MAMarine Traffic - ship tracks, port calls and moreMontreal BIXI Bike ShareNYC Taxi Trip Data 2009-NYC Taxi Trip Data 2013 (FOIA/FOILed)NYC Uber trip data April 2014 to September 2014Open Traffic collectionOpenFlights - airport, airline and route dataPhiladelphia Bike Share Stations (JSON)Plane Crash Database, since 1920RITA Airline On-Time Performance dataRITA/BTS transport data collection (TranStat)Toronto Bike Share Stations (XML file)Transport for London (TFL)Travel Tracker Survey (TTS) for ChicagoU.S. Bureau of Transportation Statistics (BTS)U.S. Domestic Flights 1990 to 2009U.S. Freight Analysis Framework since 2007Complementary CollectionsData Packaged Core DatasetsDatabase of Scientific Code ContributionsA growing collection of public datasets: CoolDatasets.DataWrangling: Some Datasets Available on the WebInside-r: Finding Data on the InternetOpenDataMonitor: An overview of available open data resources in EuropeQuora: Where can I find large datasets open to the public?rs.io - like being punched in the brain: 100+ Interesting Data Sets for StatisticsStaTrek: Leveraging open data to understand urban lives