Data Engineer

3 days ago

Yelahanka, India CentricaSoft Full time

Title: Data Engineer - PySpark
About CentricaSoft:
CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative environment.
Role Summary
We are looking for a PySpark Developer with solid AWS or Azure or GCP experience and in-depth knowledge of CI/CD pipelines with Parquet/JSON/Avro/Iceberg/Databricks. The candidate will work on multiple ETL data processing integrations, including API data pulls, Database extracts, and handling semi-structured data. Strong SQL skills and excellent communication are essential.

Atleast 1 Cloud certification from AWS (preferable) or Azure or GCP in Data Engineer area,

Key Responsibilities
Develop, optimize, and maintain PySpark-based data processing pipelines for large-scale data workloads.
Design and implement ETL/ELT processes, including API data ingestion, database extracts, and ingestion of semi-structured data (JSON, Parquet, Avro, etc.).
Build and maintain CI/CD pipelines for data engineering workloads (code, tests, deployments, and monitoring) with data quality checks, logging, and error handling to ensure robust data pipelines.
Optimize SQL queries and data models for performance and scalability.
Contribute to documentation, best practices, and knowledge sharing within the team.

Qualifications
2-5 years of hands-on experience in data engineering.
Proficiency in PySpark and Spark-based data processing with Parquet/JSON/Avro/Iceberg/Databricks.
Solid cloud experience (AWS or Azure or GCP) with data services (e.g., AWS Glue/SageMaker, EMR/Redshift; Azure Data Factory/Databricks; GCP BigQuery/Dataflow/Dataproc, AirFlow, etc).
Strong understanding of CI/CD concepts and experience implementing pipelines (e.g., Git, CI servers, containerization, automated testing, deployment automation).
Deep SQL expertise (query tuning, performance optimization, complex joins, window functions).
Excellent communication skills and ability to collaborate with cross-functional teams.
Familiarity with big data processing frameworks, data modeling, and data governance concepts.

Certifications:
Atleast 1 Cloud certifications from AWS or Azure in Data Engineer area ,

Nice-to-have
Experience with streaming data (Kafka/Kinesis), and real-time processing.
Knowledge of data visualization or BI tools (Power BI, Tableau) is a plus.
What We Offer
Hybrid work culture with a mix of on-site and remote work
Competitive salary and comprehensive benefits
Flexible work arrangements and a supportive, collaborative team
Opportunities to work on impactful, scalable data platforms
Professional development support and certification encouragement

  • Data Engineer

    4 days ago

    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySparkAbout CentricaSoft:CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative...

  • Data Engineer

    3 days ago

    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySparkAbout CentricaSoft:CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative...

  • Data Engineer

    1 week ago

    Yelahanka, Karnataka, India OnebyZero Pte Ltd. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    The ability to design, implement, and optimize large-scale data and analytics solutions, Implementing ETL pipelines within and outside of a data warehouse using Python. Performing DML and DDL on Cloud Development of scripts using Python for loading, extracting, and transforming data. Assist with production issues in data warehouses like...

  • Senior Data Engineer

    1 week ago

    Yelahanka, Karnataka, India AuxoAI Engineering Pvt. Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    AuxoAI is seeking a skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have 7-10 years of prior experience in data engineering, with a strong background in Databricks. This role offers an exciting opportunity to work on diverse projects, collaborating with cross-functional teams to design, build, and optimize data...

  • Senior Data Engineer

    3 weeks ago

    Yelahanka, India Cito Techno Full time

    Company Description CITO Techno Services Pvt. Ltd. is a forward-thinking technology company specializing in IT services, business consulting, and software development. Our mission is to empower businesses with cutting-edge digital solutions that drive efficiency, innovation, and scalable growth. We combine deep industry expertise with agile methodologies to...

  • Lead Data Engineering

    2 weeks ago

    Yelahanka, Karnataka, India ANRGI TECH Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and...

  • Lead Data Engineer T500-20510

    1 day ago

    Yelahanka, India ANSR Full time

    ANSR is hiring for one of its clients. About Dr. Martens: Dr. Martens is an iconic British brand founded in 1960 in Northamptonshire. Produced originally for workers looking for tough, durable boots, the brand was quickly adopted by diverse youth subcultures and associated musical movements. Dr. Martens has since transcended its working-class roots while...

  • Data Visualization Engineer

    4 weeks ago

    Yelahanka, Karnataka, India Raytheon Technologies Full time

    Date Posted 2024-09-02Country IndiaLocation North Gate Business Park Sy No 2 1 and Sy No 2 2 KIAL Road Venkatala Village Chowdeshwari Layout Yelahanka Bangalore Karnataka 560064Position Role Type UnspecifiedOverview We are seeking for a Data Visualization Engineer Job Title Associate EngineerKey Responsibilities Data Analysis and Requirements...

  • Associate Data Scientist

    4 weeks ago

    Yelahanka, Karnataka, India Raytheon Technologies Full time

    Date Posted 2024-03-26Country IndiaLocation North Gate Business Park Sy No 2 1 and Sy No 2 2 KIAL Road Venkatala Village Chowdeshwari Layout Yelahanka Bangalore Karnataka 560064Position Role Type UnspecifiedKey Responsibilities Design develop and deploy state-of-the-art data-driven predictive descriptive models to solve business and engineering...

  • Data Analyst

    3 hours ago

    Yelahanka, Karnataka, India GeekSoft Consulting Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Help design, build and continuously improve the clients online platform Research, suggest and implement new technology solutions following best practices/standards Take responsibility for the resiliency and availability of different products Be a productive member of the team. Requirements We are looking for a Financial Data Analyst to...