Big Data Engineer with Devops Expert

2 weeks ago


Bengaluru, Karnataka, India Damco Solutions Full time

At Damco Solutions, we're seeking a highly skilled Big Data Engineer with Devops expertise to join our team.

We offer an attractive salary of approximately ₹25,00,000 - ₹40,00,000 per annum, depending on experience and qualifications.

Job Description:

The ideal candidate will have about 6-11 years of experience in building highly scalable business applications involving large complex data flows and huge amounts of data. They must be proficient in Hadoop, Hive, Spark with Scala, with good experience in performance tuning and debugging issues.

A strong background in cloud providers such as AWS or Azure is essential, with hands-on experience in designing and developing Big Data projects. Familiarity with functional programming and OOP concepts, SOLID principles, design patterns for developing scalable applications is also required.

Responsibilities:

  • Create and maintain optimal data pipeline architecture
  • Assemble large complex data sets that meet functional/non-functional business requirements
  • Identify design and implement internal process improvements: automating manual processes, optimizing data delivery, coordinating to re-design infrastructure for greater scalability
  • Work with stakeholders including Executive Product Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
  • Ensure data separation and security
  • Collaborate with data and analytics experts to enhance functionality in our data systems
  • Support PROD systems

Qualifications:

  • About 6-11 years of experience with at least 3 years relevant experience in Big Data
  • Experience in building highly scalable business applications involving large complex data flows and huge amounts of data
  • Proficiency in Hadoop, Hive, Spark with Scala, with good experience in performance tuning and debugging issues
  • Strong background in cloud providers such as AWS or Azure
  • Familiarity with functional programming and OOP concepts, SOLID principles, design patterns for developing scalable applications


  • Bengaluru, Karnataka, India Wipro Full time

    Job SummaryWe are seeking an Expert Big Data Engineer to join our team at Wipro. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark.About the RoleThis is a senior-level position that requires excellent knowledge of Spark, Scala, and PySpark. You...


  • Bengaluru, Karnataka, India Awign Expert Full time

    A highly skilled DevOps Infrastructure Engineer is sought after by Awign Expert, a leading work-as-a-service platform in India. This role is perfect for those who are passionate about developing and maintaining high-performing infrastructure systems.The ideal candidate will have 4-5 years of experience in DevOps engineering, with a strong background in...


  • Bengaluru, Karnataka, India PW (PhysicsWallah) Full time

    Company OverviewPhysicsWallah is a leading educational institution with over 6 million students, committed to providing affordable and high-quality education. Our faculty of best-in-class experts supports students in achieving their academic goals.Job OverviewWe are seeking an experienced Big Data Analytics Expert to join our team at PW (PhysicsWallah). As a...


  • Bengaluru, Karnataka, India Awign Expert Full time

    Job Summary:Data Quality Assurance ExpertA talented Data Quality Assurance Expert is required by Awign Expert to ensure the accuracy, completeness, and consistency of our data. This role will play a crucial part in testing and validating data to maintain the highest standards of quality.About the Role:This position involves collaborating with...

  • Big Data Expert

    1 week ago


    Bengaluru, Karnataka, India LTIMindtree Full time

    LTIMindtree is a leading global consulting and IT services company that offers innovative solutions to its clients.We are currently seeking a highly skilled Big Data expert to join our team. The ideal candidate will have 8-12 years of experience in working with Big Data technologies, particularly Apache Spark for real-time streaming using Kafka.This role...


  • Bengaluru, Karnataka, India Walmart Global Tech India Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at Walmart Global Tech India. As a key member of our engineering team, you will play a critical role in designing, building, and deploying cutting-edge big data solutions that drive business value for our customers.


  • Bengaluru, Karnataka, India Nielsen Full time

    Software Engineering Expert with Big Data AnalyticsWe are seeking an experienced software engineer to join our team as a Senior Software Engineer in Big Data Analytics. This role will involve working on highly complex application software built on Big Data.About NielsenNielsen is a leading global information and measurement company that provides powerful...


  • Bengaluru, Karnataka, India AppSierra Solutions Pvt Ltd Full time

    We are seeking a seasoned data engineer to lead the development and deployment of big data pipelines using AWS DataBricks.With 5-7 years of experience in software development on AWS, you will have strong hands-on knowledge of AWS DataBricks, DevOps, Kubernetes, and cloud services such as S3, Redshift, EC2, and Lambda. Additionally, you will have extensive...


  • Bengaluru, Karnataka, India Talentpro Edge Full time

    Talentpro Edge is seeking a highly skilled Data Engineer to join our team. We offer a competitive salary of $**120,000 - 180,000 per year**.Job Description:We are looking for a seasoned Data Engineer who can design, develop, and maintain large-scale data processing systems using Google Cloud Platform technologies such as BigQuery, Dataflow, and Dataproc. The...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using Databricks on AWS.Job Responsibilities:Design and develop efficient data pipelines using Apache Spark and Databricks.Ingest data from multiple...


  • Bengaluru, Karnataka, India Ahvi Infotech Full time

    About the Job OpportunityEstimated Salary: ₹ 20,00,000 - ₹ 50,00,000 per annum.We are seeking an experienced Big Data Engineer with a strong background in Azure technologies to join our team at Ahvi Infotech. As a key member of our data engineering team, you will design, implement, and maintain large-scale data pipelines on Azure.Key...


  • Bengaluru, Karnataka, India Altimetrik Full time

    Job DescriptionWe are seeking an experienced Big Data Engineering Lead to join our team at Altimetrik. In this role, you will be responsible for overseeing the development and maintenance of reliable and scalable ETL pipelines on big data/cloud platforms.As a key member of our team, you will collaborate with other teams to design, develop, and deploy data...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    LTIMindtree is looking for a Senior Big Data Analytics Expert to join our team. This role involves designing and implementing scalable big data solutions using PySpark, SQL, and Hive.The ideal candidate should have at least 5 years of experience in big data engineering with expertise in data processing, ETL, and data warehousing.We are based in Bengaluru,...


  • Bengaluru, Karnataka, India Grid Dynamics Full time

    About the RoleGrid Dynamics is seeking a highly skilled Big Data Analytics Expert to support the enhancement of our Core Data Assets and manage regular development and deployment activities.

  • Data Engineer

    2 months ago


    Bengaluru, Karnataka, India ADCI - Karnataka Full time

    About the RoleAs a Data Engineer on the Music Data Experience team at Amazon Music, you will be responsible for designing, building, and maintaining large-scale data pipelines and platforms that support our music streaming services. You will work closely with cross-functional teams to develop data solutions that meet the needs of our business and...


  • Bengaluru, Karnataka, India Capco Full time

    Job DescriptionGreetings from Capco, a leading consulting firm specializing in banking and financial services.We are seeking an experienced Data Engineer to join our team in Bangalore, India.The ideal candidate will have at least 2 years of hands-on experience in Scala and a strong background in big data tools such as Hadoop, Spark, Hive, etc.Key...

  • Data Architect

    2 weeks ago


    Bengaluru, Karnataka, India Kognivera It Solutions Private Limited Full time

    Seeking an experienced Data Architect with a proven track record in designing and implementing scalable big data solutions on distributed platforms. As a key member of our team, you will be responsible for architecting data products using AWS services, data warehousing tools, and designing data platforms.About UsKognivera It Solutions Private Limited is a...


  • Bengaluru, Karnataka, India Synechron Full time

    At Synechron, we are seeking an experienced Informatica Big Data Management Expert to join our team in Bangalore GTP. The estimated annual salary for this role is ₹2,500,000 - ₹4,000,000.Job OverviewWe have an immediate opportunity for a skilled Informatica Big Data Management expert to work on various projects and contribute to the company's growth. As...


  • Bengaluru, Karnataka, India Luxoft Full time

    Job Description:We are seeking a highly skilled Big Data Analytics Expert to join our team at Luxoft. This is a unique opportunity to work with cutting-edge technologies and be part of a dynamic environment that fosters innovation and growth.Responsibilities:Design, develop, and maintain large-scale data architectures using Spark, Scala, Kafka, Hive, and...


  • Bengaluru, Karnataka, India Nexthire Full time

    We are seeking a skilled Big Data Engineer to join our team in Bangalore. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining our data processing and analytics infrastructure.