Varun Joshi

Senior AI Data Engineer

Seattle, United States (-08:00 UTC) English, Hindifrom Seattle, United States
Usually responds in 10 hours
Free
Price per hour
30 min
Time Blocks Available
0.00
0 reviews / 0 sessions
Tue
18
Next availability

Bio

Varun has designed and deployed AI-driven Data solutions, integrating LLM-powered coding assistants into Data Engineering to produce AI solutions for customers. Focused on leveraging LLMs and advanced engineering to build scalable, secure, and trustworthy platforms, resulting in significant efficiency gains, reduced on-call burden,and improved customer trust.He is currently Driving AI adoption across teams to enhance productivity, streamline deployments, and improve end-user experience. Beyond his engineering role, Varun is a Fellow at IETE, Fellow at SCRS, Senior member at IEEE and IEEE-published author, a technical writer on DZone and Hackernoon, and a conference speaker whose work has been accepted at international industry events. Varun has been reviewing technical books with international publishers like Manning, Pragmatic Programmer and Orielly along with Judging International Awards and Conferences.

Expertise


  • Artificial intelligence

    Varun has Masters in Informations systems with Data Science as his major along with experience of over 12 years in Data engineering.Varun is passionate about leveraging Artificial Intelligence (AI) and Machine Learning (ML) and applying thoughtful mechanisms to multiple projects.

  • Data science

    Varun has Masters in Informations systems with Data Science as his major along with experience of over 12 years in Data engineering.Varun is passionate about leveraging Artificial Intelligence (AI) and Machine Learning (ML) and applying thoughtful mechanisms to multiple projects.

Toolkit


  • AWS (Amazon Web Services) logo

    AWS (Amazon Web Services)

    7 years of experience

    Varun is a Senior Data Engineer with AWS since 2022 and has delivered numerous projects along with having experience with multiple AWS services such as Spark, S3, Redshift, EMR, Lake formation, Dynamo DB etc.

Experience

  • AWS

    Senior Data Engineer
    aws.amazon.com/

    Led end-to-end design of a large-scale financial data migration, consolidating multiple regional invoice sources into a unified immutable double-entry accounting system; collaborated across 4+ teams as primary technical SME, resolving critical data discrepancies ahead of cutoff deadlines with zero production issues. Architected an intelligent Data Quality & Anomaly Detection framework by benchmarking ML algorithms (Isolation Forest, Local Outlier Factor, k-NN) and DQ libraries (AWS Glue DQ, Great Expectations, Pydeequ), establishing automated validation pipelines across cloud storage and warehouse layers. Redesigned a critical revenue metric (Total Contract Value) to incorporate agreement lifecycle events; engineered an automated comparison tool that replaced 4–5 days of manual analysis with a sub-10-minute script, enabling sales planning workflows for cross-functional stakeholders. Architected a dedicated reporting cluster with encryption, secrets management, data sharing, and WLM queue configuration; led a zero-downtime parallel migration of 40+ reporting pipelines, eliminating a single point of failure that had caused multi-day business outages. Spearheaded a new product taxonomy rollout across 50+ ETL scripts spanning renewals, marketing, insights, and revenue domains; conducted phased deployments with thorough impact analysis and stakeholder communications, ensuring zero disruption to downstream consumers.

  • Premera Blue Cross

    Principal Data Engineer
    premera.com/visitor?region=pbcwa

    Served as lead engineer for orchestrating and maintaining critical monthly data exchange between Premera and Blue Cross Blue Shield, ensuring reliability and compliance across organizational boundaries. This initiative, compliant with federal HIPAA/CMS interoperability guidelines, also supports electronic data interchange (EDI) for faster provider claim processing and eventually higher customer satisfaction. Drove Premera's data platform modernization by leading a full-lifecycle Netezza-to-Snowflake migration — encompassing design, development, validation, and cutover — enabling the organization to retire legacy on-premise infrastructure and adopt cloud-native services, advanced analytics, and next-gen data engineering tools at scale. Built batch and near-real-time data pipelines using Qlik Replicate and DataStage within the Corporate Data & Analytics team; authored monitoring reports in Tableau to track production job health for QlikReplicate workflows. Conducted POC to acquire data via REST APIs using Python's Requests module and Pandas for data manipulation, demonstrating feasibility of API-driven ingestion patterns. Automated Data Validation: Developed a system that uses an LLM to automatically generate data quality rules from schema and data samples, eliminating manual rule authoring. AI Enablement & Training: Planned and facilitated an org-wide workshop training 20+ data engineers on agentic AI systems; reduced agent development and approval time from weeks to a single day.

© 2026 Growth Tonic Ltd. All rights reserved.
Made within Glyfada