Data Engineer

2 weeks ago


India avua Full time

We are seeking a talented Data Engineer to join our clients dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and systems to support our data-driven initiatives.


Responsibilities:

  • Design, build, and maintain robust, scalable data pipelines to collect, process, and store large volumes of structured and unstructured data from various sources.
  • Develop and implement efficient data models and architectures to support data analysis and reporting requirements. Optimize data storage and retrieval for performance and cost-effectiveness.
  • Integrate data from multiple sources, including databases, APIs, and streaming platforms, ensuring data consistency, accuracy, and reliability.
  • Implement data quality checks and validation processes to ensure data accuracy, completeness, and consistency. Troubleshoot and resolve data quality issues as they arise.
  • Identify and address performance bottlenecks in data processing and storage systems. Optimize query performance and resource utilization for improved efficiency.
  • Monitor data pipelines and systems for performance and reliability. Proactively identify and address issues to minimize downtime and ensure data availability.
  • Document data pipelines, architectures, and processes to facilitate knowledge sharing and collaboration across teams. Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and deliver integrated solutions.
  • Stay updated on emerging technologies, tools, and best practices in data engineering. Evaluate and incorporate new technologies and techniques to enhance data processing capabilities and efficiency.


Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer or similar role, with a strong background in designing and implementing data pipelines and systems.
  • Proficiency in programming languages such as Python, Java, or Scala, with experience in data processing frameworks like Apache Spark or Apache Flink.
  • Solid understanding of database systems, data modeling, and SQL query optimization.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud, including services like Amazon S3, EMR, Redshift, or Azure Data Lake.
  • Familiarity with containerization and orchestration tools such as Docker and Kubernetes is a plus.
  • Strong analytical and problem-solving skills, with the ability to troubleshoot complex data issues and optimize performance.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.


Preferred Qualifications:

  • Experience with big data technologies such as Hadoop, Kafka, or Hive.
  • Knowledge of machine learning frameworks and techniques.
  • Certification in cloud computing or data engineering (e.g., AWS Certified Big Data - Specialty, Google Professional Data Engineer).


Note: This is for one of our clients, not avua directly



  • india K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Aptus Data Labs

    2 days ago


    india Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • MLOps Engineer

    2 days ago


    india GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • QA Engineer

    12 hours ago


    india Data Unveil Full time

    Position Title: QA Engineer Level: Mid-Level Location: Hyderabad, Telangana. Hire Type: Full Time Start Date: Immediate Minimum 3+ years of QA experience in data projects. Collaborate with the Development/Business teams to understand the requirements. Analyzing Business Requirements/cases and developing/managing the positive/negative test scenarios cases....


  • india NTT DATA Full time

    The role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...


  • India Liberty Data Analytics Full time

    Senior Specialist, Data Solutions Provides, builds, and maintains data solutions to meet the needs of the enterprise. Helps ensure those solutions can be scaled appropriately. Under minimal to no direction, works within broad limits and authority on highly complex assignments requiring specialized knowledge. Viewed as senior resource in given field for...


  • india Liberty Data Analytics Full time

    Senior Specialist, Data Solutions Provides, builds, and maintains data solutions to meet the needs of the enterprise. Helps ensure those solutions can be scaled appropriately. Under minimal to no direction, works within broad limits and authority on highly complex assignments requiring specialized knowledge. Viewed as senior resource in given field for...

  • Data Engineer

    4 days ago


    india JRD Systems Full time

    Role : Data Engineer - AWS and Oracle Expert Job Summary: We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong focus on AWS and Oracle technologies. The Data Engineer will be responsible for...

  • Data Engineer

    3 weeks ago


    India TekJobs Full time

    Responsibilities:We are seeking a dedicated Senior Data Engineer to join our data engineering team to build and maintain scalable and reliable data engineering solutions that support our enterprise data warehouse and business analytics.·In this position, you will be responsible for designing, developing, and deploying data pipelines, workflows, and data...

  • Data Engineer

    4 weeks ago


    india TekJobs Full time

    Responsibilities: We are seeking a dedicated Senior Data Engineer to join our data engineering team to build and maintain scalable and reliable data engineering solutions that support our enterprise data warehouse and business analytics. ·In this position, you will be responsible for designing, developing, and deploying data pipelines, workflows, and data...

  • Data Engineer

    3 weeks ago


    india HTC Global Services Full time

    Position Description: • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...

  • Data Engineer

    4 weeks ago


    india Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Engineer

    4 weeks ago


    india Straive Full time

    Job Role- AWS Data Engineer Experience- 4 to 6 years Mode- Remote The Data Engineering team is looking for a Data Engineer with experience in building modern data platforms from the ground up. The successful candidate will build and maintain cloud-centric data processing capabilities that unleash the value of the data assets to gain competitive advantage in...

  • Data Engineer

    3 weeks ago


    India Straive Full time

    Job Role- AWS Data EngineerExperience- 4 to 6 yearsMode- RemoteThe Data Engineering team is looking for a Data Engineer with experience in building modern data platforms from the ground up. The successful candidate will build and maintain cloud-centric data processing capabilities that unleash the value of the data assets to gain competitive advantage in the...

  • Data Engineer

    4 weeks ago


    india ValueLabs Full time

    Experience - 6+Years Primary Skills - ADF, SQL Server, Databricks NoteBooks, Data Pipelines, SPROCs, Data Warehouse, Databricks DataLake Secondary Skills - PowerBl, Data modeling Notice Period - Immediate - 15 days Job Description: The Data Engineer is responsible for designing, developing, and maintaining data pipelines and data warehouses to support...

  • Data Engineer

    1 week ago


    india NAB Full time

    Consultant - Data Engineer role exists to ensure the delivery of the Right data to the Right customer at the Right time and at the Right Cost using the Right tools and the Right Technology on NAB’s target state Marketing Platforms. You will enable the move, flow and processing of reusable data assets in the Technology and Enterprise Operations space for...

  • Data Engineer

    1 month ago


    india Artefact Full time

    Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth. The backbone of our consulting missions, today our Data consulting team...

  • Data Engineer

    4 days ago


    india D2N Solutions Full time

    Company Description D2N Solutions is a talent and solutions provider based in Hyderabad. Our team consists of enthusiastic experts in recruitment, compliance, finance, and marketing who understand the challenges faced by both clients and candidates in today's employment climate. We offer all-inclusive support to our clients and candidates, focusing on their...

  • Data Engineer

    2 weeks ago


    india Lancesoft India Pvt Ltd Full time

    Hiring for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong...

  • Data Engineer

    1 week ago


    india UNO Digital Bank Full time

    Overview: We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data...