Waqar A.

ABOUT ME

I have expertise in the following technologies:

1. Python:

-- API Integration:
I have created API integrations for Social Media APIs like Facebook, Instagram, Twitter and YouTube. I have also built API integrations for Google Analytics, Xtremepush and many others.

-- API Development:
I have built APIs with GET, POST, PUT and DELETE Functionality using Flask module implementing JWT token for Authentication with limited expiration time.

-- ETL Pipelines:
Built Python Modules to extract data from APIs, Excel, CSV, SFTP BigQuery, SQL Server, MySQL and many others.
Built Python Modules to transform the extracted data.
Built python modules to Transfer the transformed data into various destinations like BigQuery, CSV, Excel, SFTP, SQL Server and MySQL.

-- Web Scraping
I have scraped data from various websites like 99acres.com, Amazon.com, Twitter and many others.

2. Google Cloud Platform:
I have built API Integrations, built ETL pipelines using Matillion ETL for BigQuery and Snowflake.
I have developed API integrations in Google Cloud Functions.
I have used GCS bucket to stage data.
I have used App engine to host web apps and schedule them using CRON Jobs.

3. Azure:
I have developed ETL pipelines using Azure Data Factory.
I have built API integrations using Azure functions.

4. Microsoft SQL Server.
I have built ETL Pipelines using SSIS.
I have built Complex stored procedures and optimized them for better performance and understanding.

SKILLS