Danish Sohail

Data Warehousing

• Authenticated Google Platform APIs and third-party ad sources using custom Python scripts.
• Managed role permissions using Google Cloud IAM.
• Stored extracted data in GCS buckets.
• Deployed Cloud Functions for iterative daily fetching via Cloud Scheduler.
• Deployed jobs for storing processed data in Google BigQuery.
• Visualized business data with Apache Superset.

Data Integration.

• Developed Talend ETL jobs for textile industrial leaders, including Nishat, Kohinoor, and Diamond, for data synchronization and automation.
• Designed FRS Two-Way Job for machine server data integrity and NDF PP ETL jobs to integrate Odoo ERP with FRS WIP module.
• Developed dynamic logs creation pipeline in ADF (Azure Data Factory) with SQL Server SPs and scripts integrated.

Data Visualization

• Developed and deployed Power BI dashboards for various sectors using Power BI Report Server and Service.
• Achievements include: NDF GREIGE Reporting, FonF reporting on NoSQL Firebase, dashboard migration to MySQL, and RFID scanner and DFL Site reports for efficiency analysis.
• Migrated Power BI industrial dashboards to in-house Apache Superset docker instance.

Deployment and Containerization

• Deployed apps on local server platforms using technologies including Docker, IIS, and NGINX.
• Deployed Docker and Docker Compose applications on cloud platform services (Google Cloud Run, Amazon ECR, ECS).

Automation

• Automation of different Windows processes through the utilization of PowerShell, effectively executing remote commands.
• Deployed Talend ETL jobs and Python scripts locally via Windows Task Scheduling service.
• Implemented MQTT queuing with multiple topics.

No Code Low Code

• Created Edraak Ticketing Power App incorporating Power Automate workflows and user permissions.
• Created APK for Power App using the wrap method and Azure tenant.

Server-side Scripting

• Created a Flask API for validating DigitalOcean Space.
• Created Python jobs for server-machine time difference alerts, daily production summary email alerts, C drive space monitoring, and FonF (Fone on Factory) entry email alerts.
• Built a Python GUI app for executing remote batch queries on multiple machines via server LAN connection.

• Enhanced skills in relational database design and SQL to support senior team members in accomplishing diverse data-related tasks.
• Became proficient in Power BI for developing dynamic and informative dashboards.
• Developed fluency in using Talend Open Studio (TOS) to efficiently carry out ETL tasks.
• Utilized Azure to build and deploy ETL pipelines, and manage in-house projects.