Hello

I'm Pranjal Verma, a Data Engineer at Accenture in Pune, specializing in building scalable ETL/ELT pipelines, distributed data processing systems, and cloud-native data solutions.

I work primarily with Python, SQL, PySpark, Apache Spark, Airflow, and cloud solutions, with a focus on data pipelines, automation, and reliable data architectures. I also enjoy building open-source projects and writing about data engineering at blog.pvcodes.in.

Pranjal Verma
Languages: Python, SQL, JavaScript, TypeScript
Tools: Apache Kafka, Apache Spark, Apache Airflow, BigQuery, Docker, Kubernetes, GCP, AWS

Experience

Accenture

Data EngineerSept 2024 - Present
  • Built scalable ETL/ELT pipelines using AWS Glue, PySpark, and Apache Airflow for reliable data processing and analytics.
  • Optimized distributed Spark workloads on Amazon EMR, increasing pipeline throughput by 3x through partitioning, cluster sizing, and Parquet optimization.

Walkover

Software Engineer InternJan 2024 - Sept 2024
  • Developed backend services and REST APIs using Node.js, Express, PostgreSQL, and MongoDB for production applications.
  • Implemented asynchronous workflows and optimized database operations to improve backend performance and reliability.

Projects

End-to-end cloud data pipeline for scraping and transforming VALORANT esports data using a Medallion Architecture, enabling analytics on player performance, team compositions, and map statistics.

ETL PipelineGCPPySparkAirflowTerraform

Education

Devi Ahilya Vishwavidyalaya, Indore

Master of Computer Applications (MCA) in Computer Applications

2024

Integral University, Lucknow

Bachelor of Computer Applications (BCA) in Computer Applications

2022