|

Data Engineer

Building reliable data pipelines, dimensional models, and metadata systems for analytics at scale

About Me

I'm a Data Engineer at Ruan Transportation Management Systems, where I build production data infrastructure in Azure Synapse Analytics and Microsoft Fabric. I own the ETL/ELT pipeline for our Oracle-to-cloud migration, serve as technical lead for automated data lineage across 50+ pipelines, and model the fact and dimension tables analysts rely on for enterprise reporting.

My foundation is in data science. I earned an MS in Data Science from the University of Iowa, where I prepared and analyzed 20M+ patient records for NIH-funded healthcare research. That background shapes how I build: I care about data that is well modeled, validated, and traceable, so the people analyzing it can trust what they find.

When I'm not analyzing datasets, you'll find me looking for good restaurants, enjoying a good cup of coffee while listening to music, or playing songs myself with guitar or piano. I also enjoy experimenting with AI to build my own products, like a native macOS app for configuring Bose audio settings, and exploring new AI models and features as they come out.

Austin Lee profile photo

Professional Experience

Associate Data Engineer

Ruan Transportation Management Systems
July 2025 - Present

  • To migrate on-premises Oracle workloads to the cloud, owned the end-to-end design and development of an ETL/ELT pipeline that unifies 80+ on-prem and cloud sources into silver tables without key collisions, letting both systems run in parallel through the final migration stage ahead of retiring on-prem
  • With no data lineage in place, served as technical lead for an automated lineage tracking system that integrates LLM-based analysis into CI/CD pipelines; drove architecture decisions and coordinated two engineers, automating lineage across all 50+ data pipelines, with manual validation for cases the automation can't fully resolve, and publishing it to Microsoft Purview via REST API for governance
  • Partnering with analysts on enterprise reporting, modeled and maintained 50+ fact and dimension tables as Delta tables using PySpark and SparkSQL in Azure Synapse Analytics, including 20+ schema additions, enabling new business measures and 2+ reports, including a Power BI migration to Direct Lake and a data-quality report
  • Partnered with upstream data owners to investigate and resolve production data-quality issues, including duplicate records, null metrics, incorrect aggregations, and bad key lookups, across 10+ fact tables, improving the reliability of downstream datasets and Power BI reporting
  • To keep large analytical workloads performant, applied advanced SQL query optimization and data partitioning strategies to terabyte-scale datasets, improving the performance and scalability of analytical queries
  • To evaluate an AI-powered self-service analytics agent in Microsoft Fabric, built evaluation workflows that established an accuracy baseline, showing that questions requiring business context failed without a semantic layer; now building a Fabric Ontology knowledge base to close that gap

Research Assistant

University of Iowa
July 2023 - June 2025

  • Participated in 3+ NIH-funded healthcare studies utilizing Palantir to analyze N3C data
  • Transformed 20M+ patient records using SQL and R, enhancing data analytics capabilities
  • Conducted healthcare disparity analysis using TriNetX analytics platform to identify key insights
  • Presented critical findings by visualizing data using Tableau and Excel to research team across 7 universities
  • Contributed to research analyzing patterns across 80+ healthcare sites, enabling identification of key risk factors for adverse COVID-19 outcomes

Data Analysis Consultant

CIVCO Medical Solutions
March 2025 - May 2025

  • Evaluated sales performance for CIVCO Medical Solutions to identify revenue drivers and customer patterns
  • Managed data using PostgreSQL through DBeaver to transform and clean the provided raw CRM and ERP data
  • Built Power BI dashboards integrating customer data, revenue metrics, and customer retention analytics
  • Discovered a significant business insight that their successful newly launched product has 86% expansion rate
  • Presented critical findings to their product and sales operation team

Projects

Data Engineering

All-Time Spotify Wrapped

A comprehensive data pipeline that extracts, transforms, and visualizes complete Spotify listening history using modern data engineering tools including Apache Airflow, dbt, DuckDB, and OpenLineage for data lineage tracking.

Data Engineering Apache Airflow dbt DuckDB Data Lineage
Learn More

Data Science & Analytics

Racial Disparities in Diabetes Care

Analyzed 115M+ patient records to investigate racial disparities in diabetes care outcomes for visually impaired patients, revealing significant differences in CKD risk ratios and care standards across racial groups.

Data Analysis Healthcare Statistical Analysis Research
Learn More

CSAS 2025: Quantifying MLB Home Run Attempts

Analyzed MLB Statcast data to identify key factors influencing home run attempts using bat speed, swing length, and advanced statistical modeling.

Data Analysis Sports Analytics Statistical Modeling Machine Learning
Learn More

UK-ecommerce Retention Analysis

Analyzed UK e-commerce data to uncover retention trends and actionable strategies for improving new customer retention.

Cohort Analysis Retention E-commerce SQL
Learn More

Skills

Programming Languages

Python, SQL (T-SQL, PostgreSQL), R

Tools & Platforms

Azure Synapse Analytics, Microsoft Fabric, Microsoft Purview, Azure DevOps, Apache Airflow, dbt, DuckDB, Docker, Git

Libraries & Frameworks

PySpark, SparkSQL, Delta Lake, Pandas, NumPy, Scikit-learn

Data Engineering

ETL/ELT, Dimensional Modeling, Data Warehousing, Data Lineage, Data Quality, Data Governance, CI/CD

Data Science & Analytics

Machine Learning, Statistical Analysis, A/B Testing, Power BI, Tableau

Languages

Korean (Native), English (Fluent), Japanese (Advanced; JLPT N2)

Education

Graduate Education

University of Iowa

MS in Data Science — Graduated May 2025

GPA: 3.93/4.00

Undergraduate Education

University of Iowa

BA in Computer Science — Graduated May 2024

BA in Psychology — Graduated May 2024

Minor in Japanese Language and Literature

GPA: 3.81/4.00

Publications

Madlock-Brown, C., Austin Lee, Seltzer, J., Solomonides, A., Mathews, N., Phuong, J., Weiskopf, N., Adams, W. G., Lehmann, H., & Espinoza, J. (2024). Racial Disparities in Diabetes Care and Outcomes for Patients with Visual Impairment: A Descriptive Analysis of the TriNetX Research Network. Research Square, rs.3.rs-3901158. View Paper → (Under review)

Contact

austini.lee96@gmail.com

Des Moines, IA