Data Engineer

6 days ago

Kolkata India CentricaSoft Full time

Job Description Title: Data Engineer - PySpark About CentricaSoft: CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We're growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative environment. Role Summary We are looking for a PySpark Developer with solid AWS or Azure or GCP experience and in-depth knowledge of CI/CD pipelines with Parquet/JSON/Avro/Iceberg/Databricks. The candidate will work on multiple ETL data processing integrations, including API data pulls, Database extracts, and handling semi-structured data. Strong SQL skills and excellent communication are essential. Atleast 1 Cloud certification from AWS (preferable) or Azure or GCP in Data Engineer area, Key Responsibilities - Develop, optimize, and maintain PySpark-based data processing pipelines for large-scale data workloads. - Design and implement ETL/ELT processes, including API data ingestion, database extracts, and ingestion of semi-structured data (JSON, Parquet, Avro, etc.). - Build and maintain CI/CD pipelines for data engineering workloads (code, tests, deployments, and monitoring) with data quality checks, logging, and error handling to ensure robust data pipelines. - Optimize SQL queries and data models for performance and scalability. - Contribute to documentation, best practices, and knowledge sharing within the team. Qualifications - 2-5 years of hands-on experience in data engineering. - Proficiency in PySpark and Spark-based data processing with Parquet/JSON/Avro/Iceberg/Databricks. - Solid cloud experience (AWS or Azure or GCP) with data services (e.g., AWS Glue/SageMaker, EMR/Redshift; Azure Data Factory/Databricks; GCP BigQuery/Dataflow/Dataproc, AirFlow, etc). - Strong understanding of CI/CD concepts and experience implementing pipelines (e.g., Git, CI servers, containerization, automated testing, deployment automation). - Deep SQL expertise (query tuning, performance optimization, complex joins, window functions). - Excellent communication skills and ability to collaborate with cross-functional teams. - Familiarity with big data processing frameworks, data modeling, and data governance concepts. Certifications: Atleast 1 Cloud certifications from AWS or Azure in Data Engineer area, Nice-to-have - Experience with streaming data (Kafka/Kinesis), and real-time processing. - Knowledge of data visualization or BI tools (Power BI, Tableau) is a plus. What We Offer - Hybrid work culture with a mix of on-site and remote work - Competitive salary and comprehensive benefits - Flexible work arrangements and a supportive, collaborative team - Opportunities to work on impactful, scalable data platforms - Professional development support and certification encouragement

  • Data Engineer

    1 day ago

    India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job DescriptionData Engineer – ChennaiBuild the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights.Location: Chennai, IndiaExperience: 2–3 years in data engineering or data-driven product developmentRole OverviewAs a Data Engineer, you will be responsible for building and maintaining scalable...

  • Data Engineer

    1 week ago

    India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Req ID: 343254NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Remote, Karnātaka (IN-KA), India (IN). "Key Responsibilities: Design and implement...

  • Data Engineer

    2 days ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: Snowflake - working experience...

  • Data & AI Engineer Lead

    1 day ago

    India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 344686NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data & AI Engineer Lead to join our team in Remote, Karnātaka (IN-KA), India (IN). "Job Duties: Role Overview The...

  • Data Engineer

    1 week ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: . Design...

  • Data Engineer

    6 days ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: . Design...

  • Data Engineer

    3 weeks ago

    India CX Data Labs Full time

    Job Description Hi Role - Azure Data Engineer Location - Chennai, Gurugram (5days Office) Full time Shift timing 2pm to 11pm Key Responsibilities: Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks. Collaborate with cross-functional teams to design and implement data models and data integration solutions. Create and...

  • Lead Data Engineer

    1 day ago

    Greater Kolkata Area, India Eucloid Data Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job DescriptionEucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to...

  • Azure Data Engineer

    4 weeks ago

    Pune, India Fragma Data Systems Full time

    Job Description Technology Skills - Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in...

  • Data Engineer Advisor

    6 days ago

    Hyderabad, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Advisor to join our team in Hyderabad, Telangana (IN-TG), India (IN). Job Requirements - 6-8 Yrs. of...