Data Engineer

4 weeks ago


india Straive Full time

Job Role- AWS Data Engineer

Experience- 4 to 6 years

Mode- Remote


The Data Engineering team is looking for a Data Engineer with experience in building modern data platforms from the ground up. The successful candidate will build and maintain cloud-centric data processing capabilities that unleash the value of the data assets to gain competitive advantage in the marketplace. They will be a hands-on contributor in the design and implementation of our cloud data platform that powers advanced analytics workloads.


The Data Engineer will work in an agile environment and will be responsible for building and maintaining data integration, ingestion, curation and pipeline orchestration capabilities. They are comfortable challenging assumptions to improve existing solutions and ensure the team is building the best scalable and cost-efficient product.


Responsibilities:


  • Develop, test, and deploy software to generate data assets (relational, non-relational) for use by downstream BI engineers and data scientists
  • Work with big data and cloud technologies such as EC2, Lambda, AWS Glue, Airflow, dbt, Redshift etc.
  • Work closely with stakeholders to ensure successful data asset design and development
  • Create software artifacts and patterns for reuse within the Data Engineering team.
  • Ensure data pipelines are scalable, resilient and produced with the highest quality standards, metadata and validated for completeness and accuracy
  • Work on a cross-functional Agile team responsible for end-to-end delivery of business needs
  • Help improve data management processes - acquiring, transforming and storing massive volumes of structured and unstructured data
  • Work closely with development teams to learn about needs, current processes and to promote best practices.


Required Qualifications:


  • University degree in Computer Science, Mathematics, Engineering, or related field.
  • 5+ years of experience in software engineering with strong focus on data.
  • Experience working with Cloud data platforms, preferably AWS (Lambda, Step Functions, S3, AWS Glue, Athena, Redshift).
  • An expert in Python/PySpark and SQL, including query optimization for relational, NoSQL and columnar databases.
  • Sound knowledge of CI workflows and build/test/deploy automation.
  • Strong understanding of data modelling concepts and best practices.
  • Relevant experience with IaC (Terraform, Cloud Formation)
  • Relevant experience with modern big data processing and orchestration tools such as dbt and Airflow.
  • A great teammate and self-starter, strong detail orientation is critical in this role.



  • india K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Aptus Data Labs

    2 days ago


    india Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • MLOps Engineer

    2 days ago


    india GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • QA Engineer

    13 hours ago


    india Data Unveil Full time

    Position Title: QA Engineer Level: Mid-Level Location: Hyderabad, Telangana. Hire Type: Full Time Start Date: Immediate Minimum 3+ years of QA experience in data projects. Collaborate with the Development/Business teams to understand the requirements. Analyzing Business Requirements/cases and developing/managing the positive/negative test scenarios cases....


  • india NTT DATA Full time

    The role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...

  • Data Engineer

    4 days ago


    india JRD Systems Full time

    Role : Data Engineer - AWS and Oracle Expert Job Summary: We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The Data Engineer will be responsible for...


  • india Liberty Data Analytics Full time

    Senior Specialist, Data Solutions Provides, builds, and maintains data solutions to meet the needs of the enterprise. Helps ensure those solutions can be scaled appropriately. Under minimal to no direction, works within broad limits and authority on highly complex assignments requiring specialized knowledge. Viewed as senior resource in given field for...


  • India Liberty Data Analytics Full time

    Senior Specialist, Data Solutions Provides, builds, and maintains data solutions to meet the needs of the enterprise. Helps ensure those solutions can be scaled appropriately. Under minimal to no direction, works within broad limits and authority on highly complex assignments requiring specialized knowledge. Viewed as senior resource in given field for...

  • Data Engineer

    3 weeks ago


    India TekJobs Full time

    Responsibilities:We are seeking a dedicated Senior Data Engineer to join our data engineering team to build and maintain scalable and reliable data engineering solutions that support our enterprise data warehouse and business analytics.·In this position, you will be responsible for designing, developing, and deploying data pipelines, workflows, and data...

  • Data Engineer

    4 weeks ago


    india TekJobs Full time

    Responsibilities: We are seeking a dedicated Senior Data Engineer to join our data engineering team to build and maintain scalable and reliable data engineering solutions that support our enterprise data warehouse and business analytics. ·In this position, you will be responsible for designing, developing, and deploying data pipelines, workflows, and data...

  • Data Engineer

    3 weeks ago


    india HTC Global Services Full time

    Position Description: • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...

  • Data Engineer

    4 weeks ago


    india Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    3 weeks ago


    India Straive Full time

    Job Role- AWS Data EngineerExperience- 4 to 6 yearsMode- RemoteThe Data Engineering team is looking for a Data Engineer with experience in building modern data platforms from the ground up. The successful candidate will build and maintain cloud-centric data processing capabilities that unleash the value of the data assets to gain competitive advantage in the...

  • Data Engineer

    4 weeks ago


    india ValueLabs Full time

    Experience - 6+Years Primary Skills - ADF, SQL Server, Databricks NoteBooks, Data Pipelines, SPROCs, Data Warehouse, Databricks DataLake Secondary Skills - PowerBl, Data modeling Notice Period - Immediate - 15 days Job Description: The Data Engineer is responsible for designing, developing, and maintaining data pipelines and data warehouses to support...

  • Data Engineer

    1 week ago


    india NAB Full time

    Consultant - Data Engineer role exists to ensure the delivery of the Right data to the Right customer at the Right time and at the Right Cost using the Right tools and the Right Technology on NAB’s target state Marketing Platforms. You will enable the move, flow and processing of reusable data assets in the Technology and Enterprise Operations space for...

  • Data Engineer

    1 month ago


    india Artefact Full time

    Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth. The backbone of our consulting missions, today our Data consulting team...

  • Data Engineer

    4 days ago


    india D2N Solutions Full time

    Company Description D2N Solutions is a talent and solutions provider based in Hyderabad. Our team consists of enthusiastic experts in recruitment, compliance, finance, and marketing who understand the challenges faced by both clients and candidates in today's employment climate. We offer all-inclusive support to our clients and candidates, focusing on their...

  • Data Engineer

    2 weeks ago


    india Lancesoft India Pvt Ltd Full time

    Hiring for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong...

  • Data Engineer

    1 week ago


    india UNO Digital Bank Full time

    Overview: We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data...

  • Data Engineer

    7 days ago


    India Coffeee.io Full time

    Key Qualifications: Experience: Minimum 5+ years of experience in data engineering or a related field. Technical Skills: Strong expertise in PySpark, Databricks, Python, Pandas, Hadoop, and AWS data technologies. ETL Tools: Hands-on experience with ETL frameworks and tools. Cloud Platforms: Proven experience working with AWS (S3, Redshift, Glue, etc.) or...