Data Engineer

9 hours ago

Mangalore, India Staffingine LLC Full time

Data EngineerIndia, RemoteFull Time /Contract# of Positions - 3Job SummaryThe Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise in ETL/ELT processes, and deep hands-on experience with AWS cloud services such as S3, Glue, Lambda, Redshift, Kinesis, and DynamoDB. The ideal candidate will excel in building serverless data architectures, designing efficient data models, and ensuring robust pipeline performance through monitoring and optimization. The position is remote within India and open for both full-time and contract engagements.Key SkillsData Engineering & PipelinesETL/ELT pipeline development using PythonData extraction, transformation, and loading into data lakes/warehousesWorkflow orchestration and automationReal-time and batch data processingAWS Cloud ExpertiseS3, Glue, Lambda, Redshift, AuroraKinesis (real-time streaming)DynamoDB (NoSQL databases)AWS serverless architecture designIntegration of AWS managed services for data workflowsServerless & AutomationBuilding event-driven pipelines using AWS LambdaServerless compute optimizationAutomated triggering and orchestration of data processesData ModelingDesigning schemas for relational databases (OLTP/OLAP)NoSQL data modeling and storage optimizationUnderstanding of normalization, partitioning, indexingMonitoring & OptimizationAWS monitoring tools (CloudWatch, CloudTrail)Pipeline performance tuningCost optimization across cloud resourcesCollaboration & CommunicationCross-functional collaboration with analysts, data scientists, and engineering teamsStrong problem-solving, documentation, and communication skillsMinimum QualificationsBachelor’s degree in Computer Science, Information Technology, Engineering, or related field (preferred).Strong hands-on experience with Python for data engineering tasks.Deep understanding of AWS cloud services used for data storage, streaming, ETL, and serverless compute.Experience designing and implementing ETL/ELT pipelines .Solid understanding of relational and NoSQL data modeling concepts.Professional Experience RequirementsProven experience building scalable data pipelines using Python.Experience extracting and transforming data from diverse sources into cloud-based environments.Hands-on experience with AWS services such as S3, Glue ETL, Lambda, Redshift/Aurora, Kinesis, and DynamoDB.Demonstrated ability to design and implement serverless architectures.Experience creating event-driven workflows using Lambda and other AWS triggers.Strong experience in monitoring, debugging, and optimizing cloud-based data workflows.Experience collaborating across data science, analytics, and engineering teams to deliver complete data solutions.

  • Data Engineer

    2 weeks ago

    Mangalore, India YO HR Consultancy Full time

    Data Engineer/Senior Data EngineerLocation: ChennaiExperience: 2 - 8 YearsRole DescriptionThe Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large...

  • Data engineer

    31 minutes ago

    Mangalore, India Recro Full time

    Key Responsibilities include: Data Pipeline Engineering: Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement: Collaborate with AI Consultants to prepare and manage datasets for supervised, unsupervised, and synthetic learning workflows. POC Support:...

  • Data Engineer

    2 days ago

    Mangalore, India Staffingine LLC Full time

    Data EngineerIndia, RemoteFull Time /Contract# of Positions - 3Job SummaryThe Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise in ETL/ELT processes, and deep hands-on experience with AWS cloud services such as S3,...

  • Lead Data Engineer

    3 weeks ago

    Mangalore, India Whatjobs IN C2 Full time

    Our Team: Enterprise Business Solutions Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain, and HR functions. The cross-functional team includes product owners, analysts, technologists, data engineers and more – all focused on providing Vista with...

  • Data engineer – cdp

    5 days ago

    Mangalore, India Integers.Ai Full time

    Job Description: Data Engineer – CDP Role: Data Engineer – CDP Job Location: Remote Experience: 4-8 years About the Role We are seeking an experienced Data Engineer with strong CDP expertise to join our team. The ideal candidate will have hands-on experience working with Customer Data Platforms—specifically Real-Time CDP and Salesforce CDP—along with...

  • Aws data engineer

    7 days ago

    Mangalore, India Tata Consultancy Services Full time

    Dear Candidates, Greetings from TCS!!! TCS is looking for AWS data engineer Experience: 8-10 years Location: Kolkata, Hyderabad, Bangalore, Chennai, Pune, Gurgaon Required technical skill set: AWS Data & AI Must have skill sets: Strong hands-on experience with AWS Data Services: Amazon S3, Glue, Redshift, Athena, Kinesis, EMR. Expertise in AWS AI/ML...

  • Data Center Engineer

    4 days ago

    Mangalore, India Sycomp Full time

    About the CompanySycomp is a global IT services and logistics provider with extensive expertise in cloud, data center, endpoint management and security solutions. Sycomp’s diverse team of consultants and engineers deliver on the company’s mission to tackle challenging global IT projects through its state-of-the-art integration and warehouse centers and...

  • Lead data engineer

    7 days ago

    Mangalore, India Prophecy Technologies Full time

    ???? We’re Hiring: LEAD DATA ENGINEER ???? Location: HYDERABAD(HYBRID) ???? ???? Experience: 7+ Years ⏳ Notice Period: Immediate to 30 Days Responsibilities Design, build, and optimize scalable data pipelines on Azure Data Lake, Azure Databricks, and Azure Synapse. Develop ETL/ELT workflows using Py Spark, Python, and Databricks notebooks. Implement and...

  • Engineering manager

    3 weeks ago

    Mangalore, India Tamara Full time

    ???? Data Engineering Manager II: Real-Time Data & Experimentation Platform (Remote, India) About Tamara Tamara is Saudi Arabia's first fintech unicorn ???? and the leading financial super-app in the GCC, with a mission to empower dreams through customer-centric financial solutions. We partner with giants like SHEIN, IKEA, Amazon, and Jarir , serving...

  • Azure Data Engineer

    1 week ago

    Mangalore, India Capgemini Invent Full time

    At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and...