Data Engineer

4 days ago

Solapur, India Staffingine LLC Full time

Data EngineerIndia, RemoteFull Time /Contract# of Positions - 3Job SummaryThe Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise in ETL/ELT processes, and deep hands-on experience with AWS cloud services such as S3, Glue, Lambda, Redshift, Kinesis, and DynamoDB. The ideal candidate will excel in building serverless data architectures, designing efficient data models, and ensuring robust pipeline performance through monitoring and optimization. The position is remote within India and open for both full-time and contract engagements.Key SkillsData Engineering & PipelinesETL/ELT pipeline development using PythonData extraction, transformation, and loading into data lakes/warehousesWorkflow orchestration and automationReal-time and batch data processingAWS Cloud ExpertiseS3, Glue, Lambda, Redshift, AuroraKinesis (real-time streaming)DynamoDB (NoSQL databases)AWS serverless architecture designIntegration of AWS managed services for data workflowsServerless & AutomationBuilding event-driven pipelines using AWS LambdaServerless compute optimizationAutomated triggering and orchestration of data processesData ModelingDesigning schemas for relational databases (OLTP/OLAP)NoSQL data modeling and storage optimizationUnderstanding of normalization, partitioning, indexingMonitoring & OptimizationAWS monitoring tools (CloudWatch, CloudTrail)Pipeline performance tuningCost optimization across cloud resourcesCollaboration & CommunicationCross-functional collaboration with analysts, data scientists, and engineering teamsStrong problem-solving, documentation, and communication skillsMinimum QualificationsBachelor’s degree in Computer Science, Information Technology, Engineering, or related field (preferred).Strong hands-on experience with Python for data engineering tasks.Deep understanding of AWS cloud services used for data storage, streaming, ETL, and serverless compute.Experience designing and implementing ETL/ELT pipelines.Solid understanding of relational and NoSQL data modeling concepts.Professional Experience RequirementsProven experience building scalable data pipelines using Python.Experience extracting and transforming data from diverse sources into cloud-based environments.Hands-on experience with AWS services such as S3, Glue ETL, Lambda, Redshift/Aurora, Kinesis, and DynamoDB.Demonstrated ability to design and implement serverless architectures.Experience creating event-driven workflows using Lambda and other AWS triggers.Strong experience in monitoring, debugging, and optimizing cloud-based data workflows.Experience collaborating across data science, analytics, and engineering teams to deliver complete data solutions.

  • Data Engineer

    3 weeks ago

    Solapur, India Sirius AI Full time

    Data Engineer Job Description About Sirius AI Sirius AI is a US headquartered AI Consulting services and products company with operations in India. Sirius AI focuses on Financial Services enterprises and solutions / services delivered across multiple geographies. We are an innovation-driven AI and data driven consulting services firm with a high focus on...

  • Data Engineer

    1 week ago

    Solapur, India HCLTech Full time

    We’re Expanding Our Digital & Data Talent Pool Are you a professional ready to take on enterprise-scale transformation journey? We are on a mass hiring drive and looking for experts who can bring innovation and depth to our projects.Role we are looking for: GCP Data Engineering Minimum Experience level that is needed - We are looking for minimum >6 years...

  • Data Engineer

    2 weeks ago

    Solapur, India HCLTech Full time

    We’re Expanding Our Digital & Data Talent Pool Are you a professional ready to take on enterprise-scale transformation journey? We are on a mass hiring drive and looking for experts who can bring innovation and depth to our projects.Role we are looking for: GCP Data Engineering Minimum Experience level that is needed - We are looking for minimum >6 years...

  • Data Engineer

    2 weeks ago

    Solapur, India Persistent Systems Full time

    About Position: We are seeking for Data engineer with AWS, databricks experience.Role: Data EngineerLocation: All Persistent LocationExperience: 5 to 12 YearsJob Type: Full Time EmploymentWhat You'll Do: Must have knowledge and working experience in Databricks, PySpark and in AWS, Apache Airflow, ETL, SQLLife science domain experience (Pharma), Redshift, BI...

  • Data Engineer

    2 weeks ago

    Solapur, India Persistent Systems Full time

    About Position: We are seeking for Data engineer with AWS, databricks experience.Role: Data EngineerLocation: All Persistent LocationExperience: 5 to 12 YearsJob Type: Full Time EmploymentWhat You'll Do: Must have knowledge and working experience in Databricks, PySpark and in AWS, Apache Airflow, ETL, SQLLife science domain experience (Pharma), Redshift, BI...

  • Senior Data Engineer

    4 weeks ago

    Solapur, India Atomic North Full time

    Position: Senior Data Engineer (Azure) Experience: 6+ years Skills: Azure Databricks, PySpark, Python, SQL, Azure Data Factory, Data Modelling, Data Migration, Data Warehousing Location: India (Remote / Hybrid options available) Interview Mode: Virtual Notice Period: Immediate to 30 Days Key Responsibilities Design and develop data pipelines and ETL...

  • Vice President

    4 weeks ago

    Solapur, India Capital One Full time

    Capital One has invested heavily in the cloud, in modern engineering approaches, and in attracting world class engineering talent. We experiment and innovate leveraging the latest technologies, engineer breakthrough customer experiences, and bring simplicity and humanity to banking. Together, this work helps make a difference for 65 million customers. At...

  • Azure Data Engineer

    1 week ago

    Solapur, India Tata Consultancy Services Full time

    Greetings from TCS!!!**TCS is Hiring for Azure Data Engineer**Desired Experience: 10- 12 YearsJob Location: HyderabadNotice Period: Immediate to 15 daysJob Description:Primary Skills: Microsoft SQL, Pyspark, Azure Synapse Analytics Secondary Skills: Azure Data Factory, Azure Databricks, Microsoft Fabric, Power BI, Purview

  • Azure Data Engineer

    2 weeks ago

    Solapur, India Tata Consultancy Services Full time

    Greetings from TCS!!!**TCS is Hiring for Azure Data Engineer**Desired Experience: 10- 12 YearsJob Location: HyderabadNotice Period: Immediate to 15 daysJob Description:Primary Skills: Microsoft SQL, Pyspark, Azure Synapse Analytics Secondary Skills: Azure Data Factory, Azure Databricks, Microsoft Fabric, Power BI, Purview

  • Azure Data Engineer

    3 weeks ago

    Solapur, India SystemBender Full time

    *Role: Azure Data Engineer*• Advance SQL Azure Data Factory (ADF) Databricks with PySpark Azure Synapse (added advantage) • Fully conversant with big-data processing approaches and schema-on-read methodologies is a must and knowledge of Azure Data Factory / Azure Databricks (PySpark) / Azure Data Lake Storage (ADLS Gen 2) • Good to have an excellent...