Sr. Data Engineer

12 hours ago

bangalore, India PERMEVO Full time

𝗝𝗼𝗯 𝗧𝗶𝘁𝗹𝗲: Sr. Data Engineer 𝗝𝗼𝗯 𝗟𝗼𝗰𝗮𝘁𝗶𝗼𝗻: Chennai, Tamil Nadu, India 𝗝𝗼𝗯 𝗗𝘂𝗿𝗮𝘁𝗶𝗼𝗻: Permanent 𝗝𝗼𝗯 𝗧𝘆𝗽𝗲: On-Site 𝗧𝗵𝗲 𝗖𝗵𝗮𝗹𝗹𝗲𝗻𝗴𝗲: We are seeking a skilled Sr. Data Engineer with 5-8 years of experience in building and managing data pipelines. The ideal candidate will have a strong proficiency in relational and NoSQL databases, as well as experience with data warehouses and real-time data streaming. This role requires excellent problem-solving skills, attention to detail, and the ability to work effectively in a team environment. 𝗥𝗼𝗹𝗲𝘀 & 𝗥𝗲𝘀𝗽𝗼𝗻𝘀𝗶𝗯𝗶𝗹𝗶𝘁𝗶𝗲𝘀: Design, build, and maintain efficient and scalable data pipelines to support data integration and transformation across various sources. Work with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra) to manage and optimize large datasets. Utilize Apache Spark for distributed data processing and real-time analytics. Implement and manage Kafka for data streaming and real-time data integration between systems. Collaborate with cross-functional teams to gather and translate business requirements into technical solutions. Monitor and optimize the performance of data pipelines and architectures, ensuring high availability and reliability. Ensure data quality, consistency, and integrity across all systems. Stay up to date with the latest trends and best practices in data engineering and big data technologies. 𝗘𝘀𝘀𝗲𝗻𝘁𝗶𝗮𝗹 𝗦𝗸𝗶𝗹𝗹𝘀 & 𝗥𝗲𝗾𝘂𝗶𝗿𝗲𝗺𝗲𝗻𝘁𝘀: 𝗠𝘂𝘀𝘁 𝗛𝗮𝘃𝗲: 5-8 years of experience in data engineering, with a focus on building and managing data pipelines. Strong proficiency in relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra). Experience in building data pipelines with data warehouses like Snowflake and Redshift. Experience in processing unstructured data stored from S3 using Athena, Glue, etc. Hands-on experience with Kafka for real-time data streaming and messaging. Solid understanding of ETL processes, data integration, and data pipeline optimization. Proficiency in programming languages like Python, Java, or Scala for data processing. Experience with Apache Spark for big data processing and analytics. Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills, with the ability to work effectively in a team environment. 𝗣𝗿𝗲𝗳𝗲𝗿𝗿𝗲𝗱 𝗤𝘂𝗮𝗹𝗶𝗳𝗶𝗰𝗮𝘁𝗶𝗼𝗻𝘀: Familiarity with cloud platforms like AWS, GCP, or Azure for data infrastructure.

  • Sr ETL Data Engineer

    4 days ago

    bangalore, India BigRio Full time

    Job Title: Sr ETL Data Engineer -HL7Location: Remote – India (UK Shift)Type: Full-TimeAbout BigRio:BigRio is a remote-based, technology consulting firm headquartered in Boston, MA. We specialize in delivering advanced software solutions that include custom development, cloud data platforms, AI/ML integrations, and data analytics. With a diverse portfolio...

  • Sr ETL Data Engineer

    4 days ago

    bangalore, India BigRio Full time

    Job Title: Sr ETL Data Engineer -HL7 Location: Remote – India (UK Shift) Type: Full-Time About BigRio: BigRio is a remote-based, technology consulting firm headquartered in Boston, MA. We specialize in delivering advanced software solutions that include custom development, cloud data platforms, AI/ML integrations, and data analytics. With a diverse...

  • Genai Innovation Factory

    4 days ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 318215 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a GenAI Innovation Factory - Sr GenAI Data Consultants to join our team in Bangalore Karn taka IN-KA India IN Job Duties Job...

  • Sr Data Engineer

    4 days ago

    Bangalore, Karnataka, India Elanco Full time

    At Elanco NYSE ELAN - it all starts with animals As a global leader in animal health we are dedicated to innovation and delivering products and services to prevent and treat disease in farm animals and pets We re driven by our vision of Food and Companionship Enriching Life and our approach to sustainability - the Elanco Healthy Purpose TM - to advance the...

  • Data Engineer

    4 days ago

    bangalore, India Aezion, Inc Full time

    Sr. Data Engineer Location: Bangalore /Coimbatore Job Type: Full-Time Required Skills and Qualifications: 8+ years of experience in Data Engineering and Analytics, with at least 2+ years in a leadership role. Proven experience managing global teams, both onsite and offshore. Strong hands-on technical background in Big Data, streaming Platforms, Databricks,...

  • Data Engineer

    3 days ago

    bangalore, India Aezion, Inc Full time

    Sr. Data Engineer Location: Bangalore /Coimbatore Job Type: Full-Time Required Skills and Qualifications: 8+ years of experience in Data Engineering and Analytics, with at least 2+ years in a leadership role. Proven experience managing global teams, both onsite and offshore. Strong hands-on technical background in Big Data, streaming Platforms, Databricks,...

  • Sr. Performance Engineer

    4 days ago

    bangalore, India Tata Consultancy Services Full time

    Role**: Sr. Performance Engineer Required Technical Skill Set: Sr. Performance Engineer Desired Experience Range: 7 - 10 yrsNotice Period: Immediate to 90Days onlyLocation of Requirement: BangaloreWe are currently planning to do a Virtual Interview Job Description:Experience in streaming media, content distribution, or video technology, proven expertise in...

  • Data Engineer

    4 days ago

    bangalore, India Aezion, Inc Full time

    Sr. Data EngineerLocation: Bangalore /CoimbatoreJob Type: Full-TimeRequired Skills and Qualifications:8+ years of experience in Data Engineering and Analytics, with at least 2+ years in a leadership role.Proven experience managing global teams, both onsite and offshore.Strong hands-on technical background in Big Data, streaming Platforms, Databricks,...

  • Sr. Performance Engineer

    2 weeks ago

    bangalore, India Tata Consultancy Services Full time

    Role**: Sr. Performance Engineer Required Technical Skill Set: Sr. Performance Engineer Desired Experience Range: 7 - 10 yrs Notice Period: Immediate to 90Days only Location of Requirement: Bangalore We are currently planning to do a Virtual Interview Job Description: Experience in streaming media, content distribution, or video technology, proven expertise...

  • Sr. Data Engineer – AWS Databricks

    2 weeks ago

    bangalore, India Gravity Infosolutions, Inc. Full time

    Role: Sr. Data Engineer – AWS Databricks / Data Tech Lead Type: Contract Location: Chennai / Hyderabad Experience: 5+ years Duration: 3 Months+ Extendable Key Responsibilities: Data Pipeline Development: Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently. Manage...