Skip to content

Issues: privacy-tech-lab/gpc-web-crawler

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
8 Open 67 Closed
8 Open 67 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Implement put request to write site-id in output data core functionality New big feature
#40 by Jocelyn0830 was closed Apr 23, 2023
@katehausladen @Jocelyn0830
4 👍 1
Analyze DNS link failures bug Something isn't working
#57 by OliverWang13 was closed Jul 25, 2023
@katehausladen @OliverWang13
12 👍 1
Update readme and architecture diagram documentation Improvements or additions to documentation
#49 by SebastianZimmeck was closed Jun 17, 2023
@katehausladen
2 👍 1
Which computers will we use to crawl? infrastructure An issue relate to underlying compute or selecting technologies
#69 by katehausladen was closed Oct 24, 2023
@katehausladen @Jocelyn0830
5 👍 1
Delete Google Cloud project infrastructure An issue relate to underlying compute or selecting technologies
#47 by katehausladen was closed Jun 12, 2023
@katehausladen
1 👍 1
Create a batch analysis feature with Puppeteer data analysis A data analysis issue
#11 by OliverWang13 was closed Aug 11, 2022
@OliverWang13 @Jocelyn0830
2 👍 1
Find a solution for sites that do not navigate bug Something isn't working
#8 by Jocelyn0830 was closed Aug 2, 2022
@Jocelyn0830
4 👍 1
Update readme to describe analysis documentation Improvements or additions to documentation
#66 by SebastianZimmeck was closed Sep 25, 2023
@katehausladen
1 👍 1
Test and improve performance of firefox-analysis-mode-crawler enhancement New feature
#10 by Jocelyn0830 was closed Aug 19, 2022
@sophieeng @Jocelyn0830
39 👍 1
Prevent crawler from being killed by one site bug Something isn't working
#13 by Jocelyn0830 was closed Aug 18, 2022
@Jocelyn0830
2 👍 1
Fix duplicate and empty entries when creating Google Sheet crawl Perform crawl or crawl feature-related data analysis A data analysis issue discussion Let's talk about this invalid This doesn't seem right
#119 by franciscawijaya was closed Jul 12, 2024
@SebastianZimmeck @Mattm27 @franciscawijaya
21 👍 1
Perform February Crawl
#85 by katehausladen was closed Feb 12, 2024
@katehausladen @sophieeng
@Mattm27 @franciscawijaya
3 👍 1
Update readme and other documentation once we settle on new methodologies documentation Improvements or additions to documentation
#65 by SebastianZimmeck was closed Nov 28, 2023
@katehausladen @OliverWang13
2 👍 1
How can we best utilize Privacy Pioneer discussion Let's talk about this
#64 by OliverWang13 was closed Sep 12, 2023
@katehausladen @OliverWang13
9 👍 1
Update readme & readme architecture documentation Improvements or additions to documentation
#56 by katehausladen was closed Jul 15, 2023
@katehausladen
2 👍 1
Identify sites that go to "Access Denied" or "Verify you are a human" pages when loaded enhancement New feature
#51 by katehausladen was closed Jun 30, 2023
@katehausladen
5 👍 1
Develop a cloud crawler core functionality New big feature
#20 by Jocelyn0830 was closed Feb 12, 2023
@katehausladen @Jocelyn0830
17 👍 1
Refactor gpc-analysis-extension core functionality New big feature
#22 by Jocelyn0830 was closed Jan 22, 2023
7 tasks done
@katehausladen @Jocelyn0830
1 👍 1
Export analysis data to external database core functionality New big feature
#23 by Jocelyn0830 was closed Jan 22, 2023
@katehausladen @Jocelyn0830
16 👍 1
Explore REST api provided by Google Cloud/Firebase core functionality New big feature
#25 by katehausladen was closed Dec 31, 2022
@katehausladen @sophieeng
5 👍 1
Test and improve the performance of local crawler core functionality New big feature
#37 by Jocelyn0830 was closed May 26, 2023
@katehausladen @Jocelyn0830
7 👍 1
Add OptanonConsent columns
#61 by katehausladen was closed Jul 28, 2023
@katehausladen
4 👍 1
Security alert dependencies Pull requests that update a dependency file
#32 by Jocelyn0830 was closed Feb 19, 2023
@katehausladen @Jocelyn0830
👍 1
Analyze and improve performance of cloud and local crawler core functionality New big feature enhancement New feature
#33 by Jocelyn0830 was closed Mar 27, 2023
@katehausladen @Jocelyn0830
7 👍 1
Add architecture diagram documentation Improvements or additions to documentation
#35 by katehausladen was closed Apr 30, 2023
@katehausladen
6 👍 1
ProTip! Updated in the last three days: updated:>2024-07-26.