Senior Data Engineer · Gurugram, Haryana, India
8+ years building scalable data platforms, real-time pipelines, and analytics engineering solutions. Specialized in ELT/ETL architecture, dimensional data modeling, SCD Type 2, semantic layer design, and LLM-integrated semantic querying systems.
Senior data engineering roles across startups and enterprises
Optimized pipeline performance at Taazaa Inc
Increased product inventory while maintaining cost-efficient compute
Core Stack: SQL · Python · Snowflake · BigQuery · DBT · AWS · GCP · Airflow · Fivetran · Tableau · Power BI · Looker Studio · Metabase · Git · CI/CD
Focus Areas: Modern Data Stack | Analytics Engineering | Semantic Layer Architecture | Real-Time Data Processing | Performance Optimization | Data Governance | BI Enablement
Senior Data Engineer with over 8 years of experience building scalable data platforms, real-time pipelines, and analytics engineering solutions using SQL, Python, Snowflake, DBT, and AWS. Specialized in ELT/ETL architecture, dimensional data modeling, SCD Type 2 implementations, semantic layer design, query optimization, and self-service analytics enablement.
Experienced in developing metadata-driven data workflows and LLM-integrated semantic querying systems to reduce ad-hoc SQL dependency and standardize business metrics. Open to Senior/Lead Data Engineering opportunities in Data Platform Engineering, Snowflake/DBT ecosystems, and scalable analytics architecture.
Engineered scalable ETL pipeline via REST APIs, reducing runtime by 50% and enabling real-time dropshipping updates. Automated DBT transformations for faster refresh cycles. Orchestrated SSIS pipelines for PostgreSQL-to-SQL Server migration.
Architected PostgreSQL schema for product catalog integration. Built Python ingestion framework centralizing structured and unstructured data into a Data Lake. Integrated Airbyte for marketing, order, and user data ingestion.
Designed Apache Superset dashboards with optimized SQL and caching. Built Power BI reports integrating multi-source data. Led user acquisition analytics transforming raw marketing data into actionable insights. Implemented large-scale web scraping pipelines for competitive intelligence.
Engineered end-to-end ELT pipeline using Fivetran, DBT, and Snowflake with real-time reporting through Metabase. Developed Python-based backup automation for Google BigQuery, exporting tables and view definitions to GCS for disaster recovery.
Designed predictive analytics models to assess daily application traffic and identify high-value customer segments. Built self-serve ad-hoc reporting framework for regional marketing teams to monitor and optimize campaign performance using SQL and visualization tools.
Designed shell-script ETL pipelines (PostgreSQL → Snowflake) using COPY, PUT, and Stored Procedures. Engineered full and incremental data replication with partitioning and indexing. Migrated enterprise datasets from SQL Server to Teradata using IICS and BTEQ. Built audit framework to validate ETL runs and improve data trustworthiness.
Built business Data Marts for game session analytics, real-time engagement tracking, and performance reporting. Automated FTP and cross-system file transfers using Python and Shell scripting. Analyzed Oracle DB structures to define key KPIs and developed Power BI POCs for stakeholder validation.
Built interactive Tableau dashboards including Profit & Loss Tracker, Employee Goal Dashboard, Demand Planning Calendar with predictive analytics, and Landing Page Navigator. Created custom One-Click Export Extension using JavaScript & Tableau's Extension API. Benchmarked Tableau, Power BI, Sisense, and Google Data Studio for build time and usability.
Bachelor of Technology –
Aug 2014 – May 2018
Saumya Kumar