Hi! I'm Bhavya Joshi. I'm a Data Engineer. I’m a Dublin-based Senior Consultant at Deloitte Ireland, specialising in data engineering and enterprise data platforms. I hold an MSc in Data Science & Statistical Learning from the University of Limerick. My experience spans building data pipelines, validating data quality, and supporting secure, reliable Hadoop environments. I enjoy solving problems across the data lifecycle - from ingesting source files to transforming datasets and making them ready for analysis.
Download CV Hire MePython & PySpark
SQL, HiveQL, MariaDB
Databricks & Delta Lake
Cloudera & Hadoop
ETL Pipelines & Oozie
Data Quality & Validation
Data Engineer and Hadoop Platform Administrator
CovidProtect - Android App Development
Research on IOT and interfacing Boards
Deduplicator Tool - Machine Learning Project
Social Impact IOT project
Mentor-Mentee System - Website Development and Database Management
University of Limerick, Ireland.
University of Mumbai, India.
The SIO's Vani Vidyalaya, India.
The SIO's Vani Vidyalaya, India.
"IETE 52nd MTS-2021, Emerging Trends in ICT & Electronics"
"International Conference on Multidisiplinary Research & Development (ICMRD-21 ), on 31 March 2021"
"IEEE 4th Biennial International Conference on Nascent Technologies in Engineering ICNTE, 2020"
"Internamtional Journal of Emerging Technologies and Innovative Research, 2019."
Build and automate data ingestion and transformation pipelines using PySpark, Hive, SQL, and Oozie.
Develop data processing workflows using Databricks, Apache Spark, and Delta Lake.
Manage and troubleshoot Cloudera environments, including HDFS, YARN, Hive, and Spark.
Implement source-to-target comparisons, data cleansing, and hash-based validation using PySpark and SQL.
Configure Ranger access policies, Kerberos authentication, HDFS encryption, and disaster recovery replication.
Deliver technical workshops, mentor colleagues, and collaborate with stakeholders to solve data challenges.
personal portfolio
Personal Portfolio for presenting my projects and achievements.
Utsav Creationss
Developed an E-commerce website for selling Jewellery and other accessories.
Covid Protect App
Managed to lead the team to develop Admin Feature for CovidProtect App created by the team. The feature tracks and monitors health status of Employees/Students of an organization. Integrated app with an IOT device to make a unique Contactless Temperature Monitoring System.
Deduplicator tool
A Deduplication system which identifies all the duplicates/ similar records from
a given dataset using machine learning algorithms. User can itself train the
dataset by giving a few samples of original records and duplicate records and
then on the basis of training the whole dataset will work on the algorithm and
will generate files containg unique records and similar records clustered.
Records such as A kumar, Akshay k, Akshay Kumar will be considered as same
record if other attributes are also similar.
Car Price Prediction
A model is developed using Random Forest Regressor for predicting the price of a car based on the parameters such as Year, Showroom price, Kilometers drived, No. of previous owners of car, Fuel type, Dealer or Individual, Transmission type. The model is trained using a dataset available on Kaggle
Flight Fare Prediction
A model is developed using Random Forest Regressor for predicting the fare of a flight based on the parameters such as Departure Date and Time, Arrival Date and Time, Source, Destination, No. of stops, Airline. The model is trained using a dataset available on Kaggle
Heart Disease Prediction
A model is developed using Logistic Regression for predicting the chances of having higher/lower risk of heart disease on the basis of factors such as Cholestrol, Fasting blood sugar, Age, Gender, Chest pain, etc.
+353 89 491 3787
joshibhavya2000@gmail.com
Kilkenny, Ireland
Category - Web Application
Personal Portfolio for presenting my projects and achievements.