Senior Data Engineer

2 days ago

Thoothukudi, India Cloudwick Full time

About the roleWe are seeking Senior Data Engineers to join our data engineering team, who are passionate about data & analytics. The ideal fit for the role will have a strong background in handling large volumes of data with Apache Spark to build , enhance bespoke systems to harness data .The key focus of the position is to build or maintain systems to capture and store data on behalf of the business. Key ResponsibilitiesDesign, develop, and maintain ETL processes and data pipelines using AWS Glue with Pyspark. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. Optimize and tune data pipelines for performance and scalability. Ensure data quality and integrity through robust testing and validation processes. Implement data governance and security best practices. Monitor and troubleshoot data pipelines to ensure continuous data flow and address any issues promptly.Stay up-to-date with the latest trends and technologies in data engineering. Required QualificationB.E/B.Tech, preferably in Computer Science Engineering with relevant work experience.7+ years of experience in handling data and designing ETL pipelines with mandatory 4+ years experience in writing Spark. Experience with AWS services such as Glue, Athena, S3, and Redshift is a plus.Good to have exposure to data modeling, data analytics, and design in both batch processing and real-time streaming. Solid understanding of data mapping, data processing patterns, distributed computing, and building applications for real-time and batch analytics Strong programming skills in design and implementation using Python, PySpark, SQL Good exposure in database architecture with SQL. Experience with multiple file formats like Avro, Parquet, ORC, and JSON. Developing, constructing, testing, and maintaining architectures for data lakes, data pipelines, data warehouses, and large-scale data processing systems on Databricks.

  • Senior Data Engineer

    3 days ago

    Thoothukudi, India Tata Consultancy Services Full time

    Role**: Senior Data EngineerRequired Technical Skill Set: Senior Data EngineerDesired Experience Range: 7 - 12 yrsNotice Period: Immediate to 90Days onlyLocation of Requirement: BangaloreWe are currently planning to do a Virtual InterviewJob Description:Primary Skills (Java, Python, etc.)Python, Scala/Java, Spark, SQL, Snowflake, BDD, Databricks, AWS Key...

  • Data engineer

    4 days ago

    Thoothukudi, India Cognizant Full time

    Note: Candidates are requested to apply only if they're available for In-person interview on 15th Nov in Bangalore Neon Office. Job Title: Senior Data Engineer – Python, AWS, Py Spark Experience Required: 4 to 9 Years Location: PAN India Employment Type: Full-Time Job Summary: We are looking for a skilled and experienced Data Engineer with strong expertise...

  • Data engineer

    2 days ago

    Thoothukudi, India HISH IT SERVICES Full time

    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (Big Query). This role requires a hands-on developer who can collaborate closely with our data and reporting teams to ensure smooth repointing and validation of Power BI reports. Request Details: Title: GCP Data Engineer Seniority: Mid to Senior...

  • Senior Backend Engineer

    3 days ago

    Thoothukudi, India Pramaan Labs Full time

    Senior Backend EngineerLocation: India - RemoteType: Full-timeCompensation: ₹20-50 LPA basis experienceWe are hiring a Senior Backend Engineer on behalf of a fast-growing SaaS startup that is building intelligent inventory and forecasting systems for modern e-commerce businesses.As one of the first backend hires, you will work closely with the CTO to...

  • Data Engineer

    1 week ago

    Thoothukudi, India Recro Full time

    Key Responsibilities include:Data Pipeline Engineering: Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.AI Data Enablement: Collaborate with AI Consultants to prepare and manage datasets for supervised, unsupervised, and synthetic learning workflows.POC Support: Implement...

  • Data Engineer

    3 days ago

    Thoothukudi, India People Prime Worldwide Full time

    About Company:-A leading global information technology, consulting, and business process services organization, the company delivers innovative solutions that enable clients across industries to thrive in the digital era. With a strong focus on technology-driven transformation, it helps enterprises harness the power of cloud, AI, automation, and analytics to...

  • Data engineer

    3 days ago

    Thoothukudi, India People Prime Worldwide Full time

    About Client: Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.7 Billion USD, with Global work force of 3,50,000 and Listed in NASDAQ, It is one of the leading IT services firms globally, known for its work in digital transformation, technology consulting, and business process outsourcing, Business Focus...

  • Senior Software Engineering Manager

    4 days ago

    Thoothukudi, India ValueMatrix.AI Full time

    Role DescriptionThis is a full-time remote role for a Senior Software Engineering Manager at ValueMatrix.ai. The Senior Software Engineering Manager will be responsible for leading a team of software engineers and managing software development projects. The Senior Software Engineering Manager will be responsible for developing software design plans,...

  • Contract Role

    3 weeks ago

    Thoothukudi, India Whatjobs IN C2 Full time

    About the job: Our client is looking for a talented experienced software development consultants, specializing in Agile Delivery. A place where you are a polyglot, working alongside the client, enabling them and adding real value to their products. A world where you are working with great, like minded people ,while you learn new technology on the go and...

  • Senior Pega Software Engineer

    6 days ago

    Thoothukudi, India Bernard Tech Full time

    Company DescriptionBernard Tech is an Israel-based company with an international presence, offering a wide range of IT-related services and solutions. We pride ourselves on being inspired by the passion, experience, and expertise of our employees. Our approach is both humble and knowledgeable, allowing us to deliver significant impact for our clients. We...