Data Engineer

3 weeks ago

Yelahanka, India CentricaSoft Full time

Title: Data Engineer - PySparkAbout CentricaSoft:CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative environment.Role SummaryWe are looking for a PySpark Developer with solid AWS or Azure or GCP experience and in-depth knowledge of CI/CD pipelines with Parquet/JSON/Avro/Iceberg/Databricks. The candidate will work on multiple ETL data processing integrations, including API data pulls, Database extracts, and handling semi-structured data. Strong SQL skills and excellent communication are essential.Atleast 1 Cloud certification from AWS (preferable) or Azure or GCP in Data Engineer area,Key Responsibilities- Develop, optimize, and maintain PySpark-based data processing pipelines for large-scale data workloads.- Design and implement ETL/ELT processes, including API data ingestion, database extracts, and ingestion of semi-structured data (JSON, Parquet, Avro, etc.).- Build and maintain CI/CD pipelines for data engineering workloads (code, tests, deployments, and monitoring) with data quality checks, logging, and error handling to ensure robust data pipelines.- Optimize SQL queries and data models for performance and scalability.- Contribute to documentation, best practices, and knowledge sharing within the team.Qualifications- 2-5 years of hands-on experience in data engineering.- Proficiency in PySpark and Spark-based data processing with Parquet/JSON/Avro/Iceberg/Databricks.- Solid cloud experience (AWS or Azure or GCP) with data services (e.g., AWS Glue/SageMaker, EMR/Redshift; Azure Data Factory/Databricks; GCP BigQuery/Dataflow/Dataproc, AirFlow, etc).- Strong understanding of CI/CD concepts and experience implementing pipelines (e.g., Git, CI servers, containerization, automated testing, deployment automation).- Deep SQL expertise (query tuning, performance optimization, complex joins, window functions).- Excellent communication skills and ability to collaborate with cross-functional teams.- Familiarity with big data processing frameworks, data modeling, and data governance concepts.Certifications:Atleast 1 Cloud certifications from AWS or Azure in Data Engineer area,Nice-to-have- Experience with streaming data (Kafka/Kinesis), and real-time processing.- Knowledge of data visualization or BI tools (Power BI, Tableau) is a plus.What We Offer- Hybrid work culture with a mix of on-site and remote work- Competitive salary and comprehensive benefits- Flexible work arrangements and a supportive, collaborative team- Opportunities to work on impactful, scalable data platforms- Professional development support and certification encouragement

  • Data Engineer

    3 weeks ago

    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySpark About CentricaSoft: CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced,...

  • Data engineer

    3 weeks ago

    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - Py SparkAbout Centrica Soft:Centrica Soft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on Py Spark Developer who thrives in a fast-paced,...

  • Data Engineer

    3 weeks ago

    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySparkAbout CentricaSoft:CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative...

  • Data Engineer

    3 weeks ago

    Yelahanka, India Ascendion Full time

    Location: Bengaluru, Chennai, Hyderabad and Pune (Hybrid Work model) Job Summary: We are looking for a talented GCP BigQuery Developer with strong SQL skills and basic proficiency in Python to join our data engineering team. The ideal candidate should have hands-on experience working with Google Cloud Platform (GCP) services, particularly BigQuery, and be...

  • Senior Data Engineer

    1 week ago

    Yelahanka, Karnataka, India AuxoAI Engineering Pvt. Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    AuxoAI is seeking a skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have 7-10 years of prior experience in data engineering, with a strong background in Databricks. This role offers an exciting opportunity to work on diverse projects, collaborating with cross-functional teams to design, build, and optimize data...

  • Sr Data Engineer

    3 weeks ago

    Yelahanka, India Accion Labs Full time

    Job Description / Skill set: Data Engineer / Data Analyst (Hybrid Role) Data Analysis: Python, Pandas, NumPy, Strong SQL, EDA techniques, Data Visualization Tools, Statistical Knowledge Data Engineering: SQL, ETL pipelines, Airflow, Spark (Optional) Data Warehouse: AWS Redshift/ GCP BigQuery Statistical Insight: Ability to assess data quality and...

  • Senior Data Engineer

    3 weeks ago

    Yelahanka, India Persistent Systems Full time

    About Position: We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data team. The ideal candidate will have deep expertise in SQL/PLSQL development, AWS cloud services, DBT (Data Build Tool), Python, and Snowflake. You will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure...

  • Senior Data Engineer

    3 weeks ago

    Yelahanka, India Josys Full time

    Location: Bengaluru, Karnataka, India About The Role We're looking for an experienced Senior Data Engineer (6-8 years) to join our data team. You'll be key in building and maintaining our data systems on AWS. You'll use your strong skills in big data tools and cloud technology to help our analytics team get valuable insights from our data. You'll be in...

  • Senior Data Engineer

    15 hours ago

    Yelahanka, India Societe Generale Global Solution Centre Full time

    Responsibilities: The role is a Senior Data Engineer who will help shape the future of data-driven auditing. With 7 - 10 years of experience, you will design and maintain scalable data pipelines, ensure compliance with global data regulations (including GDPR), and empower auditors/inspectors with high-quality data and advanced analytics. You will masterize...

  • Technical Project Manager

    3 weeks ago

    Yelahanka, India Persistent Systems Full time

    About Position: Technical Project Manager .The Role in Brief We are seeking a seasoned Technical Project Manager (TPM) in India to lead and coordinate a high-performing offshore squad of data engineering contractors for our higher education client. You will serve as the primary point of contact between the offshore team and U.S.-based leadership, ensuring...