Dhanya Vangalapudi

Hello,
I'am Dhanya Vangalapudi

View Resume

About

Hey, I'am Dhanya

I am an IT-Professional with 2.5 years of experience, currently working as a data engineer in NewsCorp. I'm always passionate about data and have experience in developing of various data engineering project. I'm a Meticulous data engineer with over 2.5 years of experience and passion for with the ability to collaborate effectively with senior developers while spending extra time to be mentored. Skilled in designing, building and maintaining data pipelines and data warehouses. Proficient in SQL and Python. Possess excellent problem-solving skills and the ability to work in a fast-paced environment.

Experience

Nov, 2023 - Present

Data Engineer

NewsCorp

Ensured data accuracy during migration through comprehensive validation checks and proactively resolved production pipeline failures to maintain high system uptime.
Designed feed registry and audit metadata tables, enhancing the efficiency and reliability of data pipelines.
Worked on ongoing automation of database and transformation DAGs using Vertex AI, aimed at reducing manual effort and expediting processes.
Engaged in data club sessions and delivered talks on the evolution of data architecture and IoT, receiving positive feedback and contributing to organizational initiatives.

June, 2022 - Nov, 2023

Data Engineer

Searce Cosourcing Services (Searce)

Designed and implemented data pipelines using GCP services like Dataflow, Cloud Storage, Pub/Sub and BigQuery to migrate data from SQL Server to BigQuery.
Successfully migrated 5TB of data from Snowflake to BigQuery using custom ETL pipelines and managed the entire process from data extraction to data validation and error handling.
Presented a demo of Datamesh capabilities to the Google Cloud team, showcasing how the platform can be used to enable data mesh architecture and improve data governance and access across the organization.
Developed and maintained data models, schemas and database structures using BigQuery and Cloud SQL.
Optimized pipeline performance and scalability by tuning SQL queries, optimizing Apache Beam code and leveraging GCP autoscaling features Collaborated with cross-functional teams including data scientists, business analysts and software engineers to design and implement data solutions that met the business needs Demonstrated expertise in all GCP services and technologies and stayed up-to-date with the latest developments and best practices in the field of data engineering.

Jul, 2021

Internship

The Spark Foundation

Performed Data Cleaning, Data Visualization and Data Analysis on the dataset
To find weak areas where we can make more profit. using Pandas, Numpy, pyplot etc: libraries.
Exploratory Data Analysis

Education

National Institute of Technology Calicut

2018 - 2022

B.Tech, Production Engineering

Secured 8.43 CGPA

Sri Chaitanya Junior College, Vishakapatnam

2015 - 2017 (Higher Secondary Education)

HSE-Andhra Pradesh Board, Mathemetics, Physics and Chemistry

Secured 977/1000 marks

Siddhartha Public School, Tuni

Upto 2015 (Secondary Education)

Andhra Pradesh Board

Secured 9.5 CGPA

Skills

Profesional Skills

Python

80%

SQL

90%

Google Cloud

80%

PySpark

70%

Airflow

80%

BigQuery

80%

Tableau

80%

Projects

MY PROJECTS

Work that I’ve done for the past 1 year

Assessment and prediction of stressors among health care workers during covid-19 using machine learning techniques

Data had collected using offline and online surveys.

Exploratory data analysis has been carried out.

A total of five machine learning algorithms has implemented for classification and prediction of stressors among health care workers.

VIEW ALL PROJECTS

Perform Exploratory Data Analysis on dataset Sample Superstore

Performed Data Cleaning, Data Visualization and Data Analysis on the dataset to find our weak areas where we can make more profit.

Design and Fabrication of UV Based Baggage Sanitization Machine

The fabricated equipment is presently being used in NIT Calicut Campus to sanitize the baggage of the students.

Our work has been featured in NITSER (Council of National Institutes of Technology, Science Education and Research) COVID 19 Pandemic Research Initiatives.

Certifications

Extra-curricular Activities

Dec, 2022 - Jan, 2023

Participated in

Jagriti Yatra

Jagriti Yatra is an ambitious train journey of discovery and transformation. It takes hundreds of India's highly motivated youth, from all over India and world, on a 15 day, 8000 km national odyssey to meet the role models - social and business entrepreneurs - of the country. Jagriti Yatra is a confluence of change-makers, leaders, problem-solvers and innovators.

Nov, 2022 - Feb, 2022

Cadet

National Cadet Corps - Naval Wing

National Cadet Corps is the youth wing of the Indian Armed Forces with its headquarters in New Delhi, India. It is open to school and college students on voluntary basis a Tri-Services Organization, comprising the Army, Navy and Air Wing, engaged in grooming the youth of the country into disciplined and patriotic citizens.

June, 2020 - April, 2022