As the stewards of ethical web data collection, the Ethical Web Data Collection Initiative (EWDCI) believes that clarity, accountability, and collaboration are foundational to a thriving, responsible web data ecosystem.

The principles outlined here are not merely guidelines; they are commitments. They reflect the collective voice of an industry determined to define its own future with integrity, transparency, and respect for the individuals and systems that comprise the Internet.

Our Core Principles:

1. Transparency by Design
Ethical data collection begins with openness. Web data collectors must be clear about their intentions, tools, and practices. Stakeholders deserve to know how, why, and what data is being collected.

2. Respect for Digital Boundaries
Honor the technical and ethical boundaries set by data owners. Robots.txt files, rate limits, and terms of service are not suggestions—they are part of a respectful digital dialogue.

3. Accountability and Responsibility
Organizations must take ownership of their data aggregation practices. That includes using responsible technology, auditing for misuse, and correcting errors when they occur.

4. Privacy-Forward Practices
Personal data must be handled with care. This means complying with privacy laws, minimizing unnecessary collection, and never collecting sensitive information without consent.

5. Commitment to Fair Use
Collected data should serve a purpose that supports innovation, public interest, or commercial fairness. Exploitative or deceptive practices have no place in ethical data collection.

6. Community and Industry Collaboration
The web is a shared space. We are stronger when we share knowledge, establish consensus-based norms, and support each other in creating better tools, standards, and outcomes.

7. Continuous Ethical Evolution
Technology moves fast, and so must our ethics. We commit to regularly revisiting and refining our principles to reflect new challenges, insights, and opportunities.

A Framework for the Future

These principles are part of a broader framework we are actively developing to promote legal clarity and industry accountability. We envision a participatory, evolving set of standards, shaped by input from the full range of stakeholders: from technologists to lawmakers, academics to advocates.

The EWDCI believes web scraping, when practiced ethically, is not only compatible with a free and open Internet but essential to it. We welcome your insights and invite you to help define what responsible data aggregation looks like in practice.

About EWDCI + i2Coalition

The Ethical Web Data Collection Initiative (EWDCI) seeks to foster cooperation in the web data collection and aggregation industry and leverage collective first-hand knowledge and insights to advocate for beneficial technical standards and business best practices regarding the aggregation of data. The EWDCI is dedicated to serving as the voice of the industry, collaboratively strengthening public trust in the practice of Data Aggregation, promoting ethical guidelines, and helping businesses make informed data aggregation choices. 

The Internet Infrastructure Coalition (i2Coalition, i2C) is the leading voice for web hosting companies, data centers, domain registrars and registries, cloud infrastructure providers, managed services providers, and related tech. The i2C works with Internet infrastructure providers to advocate for sensible policies, design and reinforce best practices, help create industry standards, and build awareness of how the Internet works. The i2Coalition also spearheaded the creation of the VPN Trust Initiative, which determined and promoted best practices for that vital industry.