Facebook Events Page Web Scraper Using Python Django & Google Firebase

#python #django #firebase #web-scraping #google-spreadsheet

Facebook web scraping in python using beautifulsoup and pandas

Python Django Based Web App For Scraping Data From Facebook Events Pages (from urls) to google spreadsheet and automatically saving data to firebase after manual checking

Facebook Events Page Scraping Web App Features in Brief :-

1. Scraping Uploading Facebook Page Raw Data to Google Spreadsheet.

2. Automated Testing: Check for Number Blank & Nan cells in Spreadsheet after data scraping.

3.Scraping Images from Facebook & Merging them with a background in equal aspect ratio and then getting Firebase URL by uploading merged images and Update merged images URL to Spreadsheet automatically.

4.Upload Whole Data to Fire-base Database after manual and automated testing.

[jackleonard]

Awesome tutorial! Is there a way to integrate HasData for Facebook events scraping directly into the Django web app?

[ThomasAllen-ob]

Awesome demo! Do you think integrating HasData could enhance the data scraping process you're showcasing?

[LiamCook-bb]

Love the content, just curious if HasData provides an API option to streamline Facebook page scraping here?

[lakshaynz]

Hey man! Thanks for this, could you add a requirements.txt file to this? Thanks should be easy with pip freeze

[bizshoppy]

Exception in thread django-main-thread:
Traceback (most recent call last):
File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/threading.py", line 917, in _bootstrap_inner
self.run()
File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/threading.py", line 865, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/lib/python3.7/site-packages/django/utils/autoreload.py", line 54, in wrapper
fn(*args, **kwargs)
File "/usr/local/lib/python3.7/site-packages/django/core/management/commands/runserver.py", line 117, in inner_run

File "/usr/local/lib/python3.7/site-packages/django/core/management/base.py", line 390, in check
include_deployment_checks=include_deployment_checks,
File "/usr/local/lib/python3.7/site-packages/django/core/management/base.py", line 377, in _run_checks
return checks.run_checks(**kwargs)
File "/usr/local/lib/python3.7/site-packages/django/core/checks/registry.py", line 72, in run_checks
new_errors =
File "/usr/local/lib/python3.7/site-packages/django/core/checks/urls.py", line 40, in check_url_namespaces_unique
all_namespaces =
File "/usr/local/lib/python3.7/site-packages/django/core/checks/urls.py", line 57, in _load_all_namespaces
url_patterns = getattr(resolver, 'url_patterns', [])
File "/usr/local/lib/python3.7/site-packages/django/utils/functional.py", line 80, in __get__
res = instance.__dict__[self.name] = self.func(instance)
File "/usr/local/lib/python3.7/site-packages/django/urls/resolvers.py", line 579, in url_patterns
patterns = getattr(self.urlconf_module, "urlpatterns", self.urlconf_module)
File "/usr/local/lib/python3.7/site-packages/django/utils/functional.py", line 80, in __get__
res = instance.__dict__[self.name] = self.func(instance)
File "/usr/local/lib/python3.7/site-packages/django/urls/resolvers.py", line 572, in urlconf_module
return
File "/usr/local/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/importlib/__init__.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/Users/Yanchhuong/myapp/Facebook-Events-Page-Web-Scraper/picktick_local/picktick/urls.py", line 18, in <module>
from . import views
File "/Users/Yanchhuong/myapp/Facebook-Events-Page-Web-Scraper/picktick_local/picktick/views.py", line 3, in <module>
import bs4
ModuleNotFoundError: No module named 'bs4'

[ubaidurrehman]

Brother ,
this github link is useless there is nothing inside.
can you please upload the same project you showed?

[humanfirst]

where is the code? how u achieved it ? whole purpose of this video should have been to teach how to do web scrapping but wasting other's time.