Muhammad Asim
Senior Python Engineer With Web Scraping Experience
Islamabad
Summary
Accomplished Senior Python Engineer with a proven track record at DrayDog, specializing in developing high-volume data scraping pipelines and leading cloud infrastructure projects. Expert in Scrapy and database design, complemented by a strong ability to foster teamwork and collaboration. Successfully designed and implemented a system scraping over 10M records hourly, showcasing technical prowess and leadership.
Overview
3
3
years of professional experience
Work History
Senior Python Engineer
DrayDog
10.2023 - Current
- Designed scrapy pipelines to scrape data from multiple port sites including YTI and WBCT
- Designed a pipeline that scrape every 1 hour over 10M+ records.
- Setup a Cloud Infrastructure over the Digital Ocean.
- Lead a team of junior teams to drive the project and address the bugs as they appear.
Full Stack Web Scraping Engineer
Chargeguard
07.2021 - 06.2023
- Designed pipelines to scrape data from Amazon Vendor Central.
- Use proxies from Webshare to unblock the data pipelines.
- ETL pipelines with Snowspark.
- Setup a Star schema for the Snowflake.
- Build a pipeline that scrapes 200K records every 2 hours.
Education
Bachelor of Science - Computer Study
FAST National Unviersity
Islamabad 04.2001 -
Skills
Scrapy, Selenium, Playwright
Database Design, Software Design
Cloud Infrastructure, Docker Management and API Developments
Reverse Engineering API
Timeline
Senior Python Engineer
DrayDog
10.2023 - Current
Full Stack Web Scraping Engineer
Chargeguard
07.2021 - 06.2023
Bachelor of Science - Computer Study
FAST National Unviersity
04.2001 -
Similar Profiles
Ajmal Khan AfridiAjmal Khan Afridi
Rehabilitation & Reconstruction Portfolio Director at SecretariatRehabilitation & Reconstruction Portfolio Director at Secretariat
Samia BasitSamia Basit
Sales Agent at Ufone - Pak Telecom MobileSales Agent at Ufone - Pak Telecom Mobile
WAQAR ALIWAQAR ALI
IBDP|CP Computer Science Teacher at Lanterna EducationIBDP|CP Computer Science Teacher at Lanterna Education
Ali NisarAli Nisar
Operations Manager (Lead Photographer) at Chaar BhaiOperations Manager (Lead Photographer) at Chaar Bhai
Derrick PSDerrick PS
Senior Python Engineer & Project Management Lead at Codenicely Software Service LLPSenior Python Engineer & Project Management Lead at Codenicely Software Service LLP