Contents

• PRODUCT END OF LIFE
• 1  Introduction
  • 1.1  About the data feeds
  • 1.2  Download schedule
    • 1.2.1  When are the domain name data provided
    • 1.2.2  Normal timings
    • 1.2.3  Unpredictable and irregular delays
    • 1.2.4  Schedule information
• 2  Feeds, download directory structures and data formats
  • 2.1  Supported and unsupported TLDs
  • 2.2  On the data feeds containing changes
  • 2.3  Data feeds, URLs, directory structures and data formats
    • 2.3.1  Feed: cctld_registered_domain_names_new
    • 2.3.2  Feed: cctld_registered_domain_names_dropped
    • 2.3.3  Feed: cctld_registered_domain_names_whois
    • 2.3.4  Feed: cctld_registered_domain_names_dropped_whois
    • 2.3.5  Feed: cctld_discovered_domain_names_new
    • 2.3.6  Feed: cctld_discovered_domain_names_whois
    • 2.3.7  Feed: cctld_discovered_domain_names_whois_archive
  • 2.4  Supported tlds
  • 2.5  Auxiliary data on actual time of data file creation
  • 2.6  Data file hashes for integrity checking
• 3  CSV file formats
  • 3.1  The use of CSV files
    • 3.1.1  Loading CSV files into MySQL and other database systems
  • 3.2  File formats
  • 3.3  Data field details
  • 3.4  Maximum data field lengths
  • 3.5  Standardized country fields
• 4  JSON file availability
• 5  Database dumps
  • 5.1  Software requirements for importing mysql dump files
  • 5.2  Importing mysql dump files
    • 5.2.1  Loading everything (including schema and data) from a single mysqldump file
  • 5.3  Database schema
  • 5.4  Further reading
• 6  Client-side scripts for downloading data, loading into databases, etc.
• 7  Tips for web-downloading data
  • 7.1  When, how, and what to download
  • 7.2  Downloaders with a GUI
  • 7.3  Command-line downloaders
• 8  Handling large csv files
  • 8.1  Line terminators in CSV files
  • 8.2  Opening a large CSV file on Windows 8 Pro, Windows 7, Vista & XP
  • 8.3  How can I open large CSV file on Mac OS X?
  • 8.4  Tips for dealing with CSV files from a shell (any OS)
• 9  Daily data collection methodology
  • 9.1  Domain life cycle and feed timings
  • 9.2  Time data accuracy
• 10  Alternative data collection methodologies for ccTLDs
• 11  Data quality check
  • 11.1  Quality check: csv files
  • 11.2  Quality check: MySQL dumps
• 12  Access via SSL Certifiate Authenticaton
  • 12.1  Setup instructions
    • 12.1.1  Microsoft Windows
    • 12.1.2  Mac OS X
    • 12.1.3  Linux
  • 12.2  Accessible URLs
• 13  FTP access of WHOIS data
  • 13.1  FTP clients
  • 13.2  FTP access
  • 13.3  FTP directory structure of legacy and quarterly subscriptions
  • 13.4  FTP firewall settings for legacy subscriptions