Python, Pyspark, SQL Developer
7 days ago
Job Description Key Responsibilities: - Design, develop, and maintain ETL pipelines using Python, PySpark, and SQL on distributed data platforms. - Write clean, efficient, and scalable PySpark code for big data transformation and processing. - Develop reusable scripts and tools for data ingestion, cleansing, validation, and aggregation. - Work with structured and semi-structured data (JSON, Parquet, Avro, etc.). - Optimize SQL queries for performance and cost-efficiency in data lakes or warehouses. - Collaborate with data architects, analysts, and BI developers to deliver end-to-end data solutions. - Participate in code reviews, peer programming, and unit/integration testing. - Support and troubleshoot issues in development, test, and production environments. - Document technical processes, data flows, and pipeline designs. Required Skills and Qualifications: - Bachelor's degree in Computer Science, Engineering, or related technical field. - 36+ years of hands-on experience in Python, PySpark, and SQL. - Proficiency in Apache Spark (RDD/DataFrame APIs), Spark performance tuning, and distributed computing concepts. - Strong experience with relational databases like PostgreSQL, SQL Server, or Oracle, and experience writing complex SQL queries, CTEs, joins, and window functions. - Familiarity with cloud platforms such as AWS, Azure, or GCP (e.g., EMR, Databricks, BigQuery, Synapse, etc.). - Experience with data lake and data warehouse concepts.
-
Pyspark +Python +SQL Professional
2 weeks ago
Bengaluru, Chennai, Gurugram, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a skilled professional with expertise in Pyspark, Python, and SQL to join our team. The ideal candidate should have 6-9 years of experience.Roles and ResponsibilityDesign, develop, and implement data processing pipelines using Pyspark.Collaborate with cross-functional teams to identify and prioritize project requirements.Develop and...
-
Data Engineer- PySpark
2 weeks ago
Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per yearBuild up data pipelines for consumption by the data science team.Clear understanding and experience with Python and PySpark.Experience in writing Python programs and SQL queries.Experience in SQL Query tuning.Build and maintain data pipelines in Pyspark with SQL and Python.Knowledge of Cloud (Azure/AWS) technologies is additional. Suggest and implement best...
-
Python Pyspark
3 days ago
Chennai, Tamil Nadu, India Virtusa Full timeData engineer 1) Overall 7+ in IT Experience with relevant 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS 2) Required Domain: Healthcare Insurance 4) Extensive data analysis skills and Good communication skills 5) Experience working in Agile **About Virtusa** Teamwork, quality of life, professional and...
-
Pyspark Developer
2 weeks ago
Chennai, Tamil Nadu, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDiscover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewAt Citi we're not just building technology, we're building the...
-
Pyspark Developer
2 weeks ago
Bengaluru, Chennai, Pune, India Quess Corp Limited Full time ₹ 8,00,000 - ₹ 24,00,000 per yearROLE SUMMARYWe are seeking a highly skilled PySpark Developer with hands-on experience in Databricks IT Systems Development unit in an offshore capacity. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform. The ideal candidate will have expertise in big data...
-
Python/Pyspark Development
1 week ago
Chennai, Tamil Nadu, India Standard Chartered Bank Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob ID: 39129Location: Chennai, INArea of interest: TechnologyJob type: Regular EmployeeWork style: Office WorkingOpening date: 10 Sept 2025Job SummaryStrategy - Deliver on the functional requirements for the Regulatory exercisesBusiness - Group Functions - FinanceProcesses - Regulatory Stress Testing.Risk Management - Group standard requirementsKey...
-
Senior Data Engineer
2 days ago
Chennai, India Devlats Pvt Ltd Full timeDescription : We are looking for an experienced Data Engineer with a strong background in Java and hands-on expertise in Python/PySpark, Big Data technologies, and Google Cloud Platform (GCP). The ideal candidate should be capable of designing, developing, and maintaining large-scale data processing systems, ensuring data quality, scalability, and...
-
Colan Infotech
4 weeks ago
Chennai, India Colan Infotech Pvt Ltd Full timePosition : Azure Data EngineerExperience : 3-5 YearsJob Type : Full-timeJob Summary :We are seeking a skilled Azure Data Engineer with 3-5 years of experience to design, develop, and maintain scalable data pipelines within the Microsoft Azure ecosystem. The ideal candidate will have strong expertise in Azure Data Factory, Azure Databricks, PySpark/Scala...
-
Pyspark Developer
2 weeks ago
Bengaluru, Chennai, Pune, India VHR Solutions Full time ₹ 5,00,000 - ₹ 12,00,000 per yearJob Description:We are looking for a skilled PySpark Developer to join our data engineering team. The ideal candidate will have strong experience in building scalable data pipelines using Apache Spark (PySpark), integrating with big data platforms, and working with large datasets in distributed environments. You will work closely with data engineers,...
-
Chennai, Tamil Nadu, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per yearExperience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key ResponsibilitiesDesign and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources.Optimize performance and scalability of data flows using tools like Apache Spark, Databricks, or AWS Glue.Collaborate with domain experts...