Hi, I'm Disha Goyal

Data Engineer | Data Analyst | Databricks Certified Data Engineer Associate

Recent MS Computer Science graduate from USC with hands-on experience building reliable data pipelines, analytics-ready datasets, machine-learning scoring workflows, and interactive dashboards. I use Python, SQL, PySpark, Databricks, Tableau, and data-quality practices to turn raw data into trusted decision-support solutions.

Professional photo of Disha Goyal
3.75
USC MS GPA
9.29
BTech GPA
100+
Research Sessions Cleaned
3
Featured Data Projects

Technical Skills

Core Competencies

Python SQL PySpark Spark SQL Apache Spark pandas scikit-learn ETL/ELT Pipelines Batch Processing Incremental Ingestion Data Cleaning Data Validation Feature Engineering Medallion Architecture Databricks Workflows Auto Loader Delta Lake Unity Catalog Databricks SQL SQLite MySQL MariaDB Dimensional Modeling Exploratory Data Analysis KPI Reporting Customer Segmentation Tableau Power BI Excel Data Storytelling

I am a Data Engineer and Data Analyst focused on building reliable pipelines, validated datasets, analytical models, and dashboard-ready outputs for reporting, BI, and machine-learning use cases.

My experience includes cleaning and validating AI-generated transcript data at USC’s Institute for Creative Technologies, extracting and documenting engineering data at Cosasco, and supporting client-facing analytics workflows at Blackcoffer.

I am especially interested in Databricks lakehouse architecture, PySpark, SQL analytics, data quality, customer and healthcare analytics, KPI development, and turning complex datasets into practical business decisions.

Professional Experience

Graduate Research Assistant - Data Engineering
Institute for Creative Technologies, USC
Jan 2026 - May 2026
  • Cleaned and validated WhisperX-generated transcription and speaker-diarization outputs for 100+ multi-issue bargaining negotiation sessions, preparing structured datasets for downstream conversational AI and negotiation-behavior research.
  • Converted raw AI-generated conversation outputs into standardized speaker-wise transcript records across session ID, speaker label, timestamp, and utterance fields.
  • Corrected speaker-attribution errors, missing dialogue turns, inaccurate text, and formatting inconsistencies to improve dataset quality, reliability, and usability for AI/ML research workflows.
Engineering Intern - Data Infrastructure
Cosasco, Santa Fe Springs, CA
Sept 2025 - Jan 2026
  • Extracted and analyzed engineering test data from Anotrol 2020 CPS using SQL and MariaDB on Raspberry Pi, supporting reliability assessment, troubleshooting, and predictive maintenance workflows.
  • Developed repeatable database export procedures and technical instructions for RDU test data, standardizing data extraction steps and reducing manual dependency for future analysis.
  • Maintained structured test-set tracking, procedure mapping, and engineering documentation to support test infrastructure, data traceability, and new product enablement workflows.
Backend and Data Analytics Intern
Blackcoffer Pvt. Ltd., Delhi, India
Jan 2024 - Jul 2024
  • Supported backend data operations for client-facing analytics dashboards by preparing structured datasets, validating data flows, and assisting with SQL-based API/data integration tasks.
  • Organized relational client data for reporting and internal analytics, troubleshooting data availability and validation issues with backend, dashboard, and frontend teams.
  • Improved reliability of analytics deliverables through data validation, issue troubleshooting, and cross-functional coordination.

Featured Projects

HealthPulse - Smart Patient Monitoring and Readmission Analytics
Databricks PySpark Spark SQL Delta Lake Machine Learning

Built an end-to-end healthcare analytics platform using Bronze, Silver, and Gold architecture to process patient, admission, condition, medication, lab, and vital-sign data.

Created Patient 360 profiles, hospital operations metrics, monitoring alerts, readmission-risk datasets, explainable risk factors, audit logging, validation checks, watermark tracking, and incremental ingestion workflows.

RetentionIQ - Telecom Churn and Retention Analytics
Python SQL scikit-learn SQLite Tableau

Built an end-to-end retention decision-support solution for 1,000 telecom customers using data validation, feature engineering, machine-learning risk scoring, SQL analytics, and Tableau.

Identified 750 actionable retention candidates, estimated $805K in annualized revenue exposure, assigned targeted retention actions, and simulated campaign outcomes across multiple budgets.

U.S. EPA Emissions Analytics Dashboard
Databricks SQL Data Visualization Data Cleaning Analytics

Built Databricks SQL workflows to ingest, clean, and transform EPA emissions data for state and county-level analysis, including numeric type conversion and population-based calculations.

Created dashboard-ready datasets and visualizations to identify high-emission regions, compare normalized emissions trends, and support geographic emissions analysis.

Additional Projects

DuckDB Zonemap Optimization
C++ DuckDB Database Systems

Extended DuckDB query execution by integrating column imprint bitmaps with zonemap pruning, improving predicate filtering efficiency. Validated performance gains using TPC-H and TPC-DS benchmarks.

Cropable - AI Crop Disease Detection
Python Flask TensorFlow Keras CNN VGG16 OpenCV

Built an AI-powered web application for crop disease detection using tomato leaf images. Implemented image preprocessing, CNN/VGG16-based classification across disease classes, and a recommendation layer that suggests treatment measures based on the detected disease.

Artist Search Backend API
Node.js MongoDB REST API

Designed REST APIs and data models to support search, filtering, and favorites workflows. Built scalable backend services delivering smooth user interactions with optimized database queries.

Twist Tile Golf
C# Unity Game Design

Designed and implemented a 2D physics-based puzzle game featuring tile-rotation interaction mechanics. Focused on intuitive player controls, physics-driven feedback, and strategic level design to enhance engagement.

FoodEsy
PHP MySQL JavaScript Bootstrap HTML/CSS

Developed a full-stack takeaway ordering system for local restaurants, enabling customers to place orders online and collect food without long queues. Implemented secure payment flows, real-time order tracking, and responsive UI.

Education

University of Southern California
Master of Science in Computer Science
Aug 2024 - May 2026 GPA: 3.75/4.0
Vellore Institute of Technology
Bachelor of Technology in Computer Science
Sep 2020 - May 2024 GPA: 9.29/10

Certifications and Professional Development

Databricks Certified Data Engineer Associate
Databricks Academy • Issued July 18, 2026
Preparing for AWS Certified Cloud Practitioner
AWS Skill Builder • Cloud fundamentals and core AWS services
Preparing for AWS Certified AI Practitioner
AWS Skill Builder • AI, machine learning, and generative AI fundamentals
Knowledge Badge - DevOps Essentials for Data Engineering
Databricks Academy • July 5, 2026
Knowledge Badge - Build Data Pipelines with Lakeflow Spark Declarative Pipelines
Databricks Academy • July 2, 2026
Knowledge Badge - Deploy Workloads with Lakeflow Jobs
Databricks Academy • June 30, 2026
Knowledge Badge - Data Ingestion with Lakeflow Connect
Databricks Academy • June 28, 2026
Knowledge Badge - SQL Analytics on Databricks
Databricks Academy
Knowledge Badge - AI/BI for Data Analysts
Databricks Academy

Let's Connect

I'm currently open to Data Engineer, Data Analyst, Analytics Engineer, Business Intelligence Analyst, and related data opportunities. Let’s discuss how I can contribute to your team.