Skip to content

Issues: privacy-tech-lab/gpc-web-crawler

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
7 Open 66 Closed
7 Open 66 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Reformat readme structure documentation Improvements or additions to documentation
#114 by SebastianZimmeck was closed Jun 17, 2024
@franciscawijaya
4
Using the [April Crawl Data](https://docs.google.com/spreadsheets/d/1xDz4RS5tlWBmAS33xVEOk2rqtc21lSkdInRv9J02ZFs/edit#gid=484688826), I tested the crawl for sites that output GPP strings (as tested in April) to check the gpp-version. Out of the 20 sites that I picked from the data, it seems that all of them used v1.1 and that data is reflected in the gpp-version column accurately. I also tested on sites that do not output GPP strings before and after the gpc signal is sent and as expected the column would reflect a 'null' value for gpc_version, since their gpp_before_gpc and gpp_after_gpc would also output a 'null' value.
#113 by Sokvy77 was closed Jun 12, 2024
Clean up Google Drive files documentation Improvements or additions to documentation
#111 by SebastianZimmeck was closed Jun 16, 2024
@SebastianZimmeck @franciscawijaya
7
Add crawler functionality for identifying sites' usage of GPP 1.0 vs 1.1 and write to database core functionality New big feature crawl Perform crawl or crawl feature-related
#110 by patmmccann was closed Jun 10, 2024
@SebastianZimmeck @Mattm27 @franciscawijaya
23
Perform June crawl crawl Perform crawl or crawl feature-related
#108 by SebastianZimmeck was closed Jun 20, 2024
@Mattm27 @franciscawijaya
12
Create new release release A release-related issue
#103 by katehausladen was closed Apr 18, 2024
@sophieeng @franciscawijaya
1
New OneTrust cookies? discussion Let's talk about this enhancement New feature
#94 by katehausladen was closed Apr 18, 2024
@katehausladen @Mattm27 @franciscawijaya
7
Remove well-known functionality from crawler and document python script for getting .well-known core functionality New big feature
#93 by Mattm27 was closed Feb 26, 2024
1
@katehausladen @Mattm27 @franciscawijaya
3
Perform April 2024 crawl crawl Perform crawl or crawl feature-related
#92 by SebastianZimmeck was closed Apr 18, 2024
@sophieeng @Mattm27 @franciscawijaya
1
Create February 2024 crawl release release A release-related issue
#91 by SebastianZimmeck was closed Feb 13, 2024
@katehausladen
1
Set up systematic way to decode GPP strings for the long term data analysis A data analysis issue
#89 by Mattm27 was closed Feb 19, 2024
@katehausladen @sophieeng
@Mattm27 @franciscawijaya
4
Understand how to run web crawl analysis scripts data analysis A data analysis issue
#88 by Mattm27 was closed Feb 26, 2024
@katehausladen @sophieeng
@Mattm27 @franciscawijaya
2
Read and revise gpc crawler checklist & readME good first issue Good for newcomers
#86 by franciscawijaya was closed Feb 26, 2024
@sophieeng @Mattm27 @franciscawijaya
2
Perform February Crawl
#85 by katehausladen was closed Feb 12, 2024
@katehausladen @sophieeng
@Mattm27 @franciscawijaya
3
Fix setup error and change readme as necessary bug Something isn't working dependencies Pull requests that update a dependency file documentation Improvements or additions to documentation
#81 by SebastianZimmeck was closed Jan 10, 2024
@katehausladen @OliverWang13 @Mattm27
1
Check sites for .well-known/gpc.json crawl Perform crawl or crawl feature-related
#77 by SebastianZimmeck was closed Jan 28, 2024
1
@SebastianZimmeck @katehausladen @Mattm27
9
Create release release A release-related issue
#76 by SebastianZimmeck was closed Jan 3, 2024
@katehausladen
1
Which computers will we use to crawl? infrastructure An issue relate to underlying compute or selecting technologies
#69 by katehausladen was closed Oct 24, 2023
@katehausladen @Jocelyn0830
5
Update readme to describe analysis documentation Improvements or additions to documentation
#66 by SebastianZimmeck was closed Sep 25, 2023
@katehausladen
1
Update readme and other documentation once we settle on new methodologies documentation Improvements or additions to documentation
#65 by SebastianZimmeck was closed Nov 28, 2023
@katehausladen @OliverWang13
2
How can we best utilize Privacy Pioneer discussion Let's talk about this
#64 by OliverWang13 was closed Sep 12, 2023
@katehausladen @OliverWang13
9
Does Google's Topics API have a consent flag that we can use similar to the US Privacy String/USPAPI? core functionality New big feature exploration Explore adding a feature etc.
#63 by SebastianZimmeck was closed Sep 26, 2023
@Jocelyn0830
9
Add OptanonConsent columns
#61 by katehausladen was closed Jul 28, 2023
@katehausladen
4
What implementation change, if any, do we need to make given the deprecation of the US Privacy String? core functionality New big feature exploration Explore adding a feature etc. omnibus An issue that covers multiple connected (smaller) sub-issues
#60 by SebastianZimmeck was closed Oct 10, 2023
@katehausladen
23
Analyze DNS link failures bug Something isn't working
#57 by OliverWang13 was closed Jul 25, 2023
@katehausladen @OliverWang13
12
ProTip! no:milestone will show everything without a milestone.