Data engineer

2 days ago

Yelahanka, India CentricaSoft Full time

Title: Data Engineer - Py SparkAbout Centrica Soft:Centrica Soft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on Py Spark Developer who thrives in a fast-paced, collaborative environment.Role SummaryWe are looking for a Py Spark Developer with solid AWS or Azure or GCP experience and in-depth knowledge of CI/CD pipelines with Parquet/JSON/Avro/Iceberg/Databricks. The candidate will work on multiple ETL data processing integrations, including API data pulls, Database extracts, and handling semi-structured data. Strong SQL skills and excellent communication are essential.Atleast 1 Cloud certification from AWS (preferable) or Azure or GCP in Data Engineer area,Key ResponsibilitiesDevelop, optimize, and maintain Py Spark-based data processing pipelines for large-scale data workloads.Design and implement ETL/ELT processes, including API data ingestion, database extracts, and ingestion of semi-structured data (JSON, Parquet, Avro, etc.).Build and maintain CI/CD pipelines for data engineering workloads (code, tests, deployments, and monitoring) with data quality checks, logging, and error handling to ensure robust data pipelines.Optimize SQL queries and data models for performance and scalability.Contribute to documentation, best practices, and knowledge sharing within the team.Qualifications2-5 years of hands-on experience in data engineering.Proficiency in Py Spark and Spark-based data processing with Parquet/JSON/Avro/Iceberg/Databricks.Solid cloud experience (AWS or Azure or GCP) with data services (e.g., AWS Glue/Sage Maker, EMR/Redshift; Azure Data Factory/Databricks; GCP Big Query/Dataflow/Dataproc, Air Flow, etc).Strong understanding of CI/CD concepts and experience implementing pipelines (e.g., Git, CI servers, containerization, automated testing, deployment automation).Deep SQL expertise (query tuning, performance optimization, complex joins, window functions).Excellent communication skills and ability to collaborate with cross-functional teams.Familiarity with big data processing frameworks, data modeling, and data governance concepts.Certifications:Atleast 1 Cloud certifications from AWS or Azure in Data Engineer area ,Nice-to-haveExperience with streaming data (Kafka/Kinesis), and real-time processing.Knowledge of data visualization or BI tools (Power BI, Tableau) is a plus.What We OfferHybrid work culture with a mix of on-site and remote workCompetitive salary and comprehensive benefitsFlexible work arrangements and a supportive, collaborative teamOpportunities to work on impactful, scalable data platformsProfessional development support and certification encouragement

  • Data Engineer

    4 days ago

    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySparkAbout CentricaSoft:CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative...

  • Data Engineer

    1 week ago

    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySpark About CentricaSoft: CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced,...

  • Data Engineer

    1 week ago

    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySparkAbout CentricaSoft:CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative...

  • Data Engineer

    1 week ago

    Yelahanka, India CentricaSoft Full time

    Title: Data Engineer - PySparkAbout CentricaSoft:CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative...

  • Data Engineer

    4 days ago

    Yelahanka, India Ascendion Full time

    Location: Bengaluru, Chennai, Hyderabad and Pune (Hybrid Work model) Job Summary: We are looking for a talented GCP BigQuery Developer with strong SQL skills and basic proficiency in Python to join our data engineering team. The ideal candidate should have hands-on experience working with Google Cloud Platform (GCP) services, particularly BigQuery, and be...

  • Data Engineer

    2 weeks ago

    Yelahanka, Karnataka, India OnebyZero Pte Ltd. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    The ability to design, implement, and optimize large-scale data and analytics solutions, Implementing ETL pipelines within and outside of a data warehouse using Python. Performing DML and DDL on Cloud Development of scripts using Python for loading, extracting, and transforming data. Assist with production issues in data warehouses like...

  • Senior Data Engineer

    2 weeks ago

    Yelahanka, Karnataka, India AuxoAI Engineering Pvt. Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    AuxoAI is seeking a skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have 7-10 years of prior experience in data engineering, with a strong background in Databricks. This role offers an exciting opportunity to work on diverse projects, collaborating with cross-functional teams to design, build, and optimize data...

  • Sr Data Engineer

    2 days ago

    Yelahanka, India Accion Labs Full time

    Job Description / Skill set: Data Engineer / Data Analyst (Hybrid Role) Data Analysis: Python, Pandas, NumPy, Strong SQL, EDA techniques, Data Visualization Tools, Statistical Knowledge Data Engineering: SQL, ETL pipelines, Airflow, Spark (Optional) Data Warehouse: AWS Redshift/ GCP BigQuery Statistical Insight: Ability to assess data quality and...

  • Senior Data Engineer

    4 days ago

    Yelahanka, India Persistent Systems Full time

    About Position: We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data team. The ideal candidate will have deep expertise in SQL/PLSQL development, AWS cloud services, DBT (Data Build Tool), Python, and Snowflake. You will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure...

  • Senior Data Engineer

    2 days ago

    Yelahanka, India Josys Full time

    Location: Bengaluru, Karnataka, India About The Role We're looking for an experienced Senior Data Engineer (6-8 years) to join our data team. You'll be key in building and maintaining our data systems on AWS. You'll use your strong skills in big data tools and cloud technology to help our analytics team get valuable insights from our data. You'll be in...