Big Data Engineer with Devops

2 weeks ago


Bengaluru, India Damco Solutions Full time

Position – Big Data Engineer with Devops

Exp - 6-10 Yrs

Job Location- Bangalore ( 3 days hybrid working )



Job Description

As a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline designer and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will lead our software developers on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.


Responsibilities

  • Create and maintain optimal data pipeline architecture
  • Assemble large complex data sets that meet functional / non-functional business requirements.
  • Identify design and implement internal process improvements: automating manual processes optimizing data delivery, coordinating to re-design infrastructure for greater scalability etc.
  • Work with stakeholders including the Executive Product Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Keep our data separated and secure
  • Work with data and analytics experts to strive for greater functionality in our data systems.
  • Support PROD systems


Qualifications

  • Must have About 6 - 11 years and at least 3 years relevant experience with Bigdata.
  • Must have Experience in building highly scalable business applications, which involve implementing large complex business flows and dealing with huge amount of data.
  • Must have experience in Hadoop, Hive, Spark with Scala with good experience in performance tuning and debugging issues.
  • Hands-on experience in one of the cloud provider (AWS/Azure) is must
  • Good to have any stream processing Spark/Java Kafka.
  • Must have experience in design and development of Big data projects.
  • Good knowledge in Functional programming and OOP concepts, SOLID principles, design patterns for developing scalable applications.
  • Familiarity with build tools like Maven.
  • Must have experience with any RDBMS and at least one NoSQL database preferably PostgresSQL
  • Must have experience writing unit and integration tests using scaliest
  • Must have experience using any versioning control system - Git
  • Must have experience with CI / CD pipeline – Jenkins is a plus
  • Databricks Spark certification is a plus.



  • Bengaluru, India Damco Solutions Full time

    Position – Big Data Engineer with DevopsExp - 6-10 YrsJob Location- Bangalore ( 3 days hybrid working )Job DescriptionAs a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced...


  • Bengaluru, India Damco Solutions Full time

    Position – Big Data Engineer with Devops Exp - 6-10 Yrs Job Location- Bangalore ( 3 days hybrid working ) Job Description As a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an...


  • Bengaluru, India Damco Solutions Full time

    Position – Big Data Engineer with DevopsExp - 6-10 YrsJob Location- Bangalore ( 3 days hybrid working )Job DescriptionAs a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced...


  • Bengaluru, Karnataka, India Damco Solutions Full time

    At Damco Solutions, we're seeking a highly skilled Big Data Engineer with Devops expertise to join our team.We offer an attractive salary of approximately ₹25,00,000 - ₹40,00,000 per annum, depending on experience and qualifications.Job Description:The ideal candidate will have about 6-11 years of experience in building highly scalable business...

  • Big Data Engineer

    5 months ago


    Bengaluru, India Telescopp Full time

    Job OverviewWe are looking for a talented Big Data Engineer to join our team in Bengaluru. This is a mid-level, full-time position requiring a minimum of 4 years to a maximum of 6 years of relevant work experience. As a Big Data Engineer at Telescopp, you will be responsible for developing, testing, and maintaining big data solutions to support our client's...


  • Bengaluru, Karnataka, India AppSierra Solutions Pvt Ltd Full time

    We are seeking a seasoned data engineer to lead the development and deployment of big data pipelines using AWS DataBricks.With 5-7 years of experience in software development on AWS, you will have strong hands-on knowledge of AWS DataBricks, DevOps, Kubernetes, and cloud services such as S3, Redshift, EC2, and Lambda. Additionally, you will have extensive...


  • Bengaluru, Karnataka, India Altimetrik Full time

    Job DescriptionWe are seeking an experienced Big Data Engineering Lead to join our team at Altimetrik. In this role, you will be responsible for overseeing the development and maintenance of reliable and scalable ETL pipelines on big data/cloud platforms.As a key member of our team, you will collaborate with other teams to design, develop, and deploy data...


  • Bengaluru, India Damco Solutions Full time

    Position – Big Data Engineer with DevopsExp - 6-10 YrsJob Location- Bangalore ( 3 days hybrid working )Job DescriptionAs a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced...

  • Data Engineer

    2 months ago


    Bengaluru, India Coders Brain Technology Private Limited Full time

    Qualifications : - Bachelor's degree in Computer Science/Engineering or similar - 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines - Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure: Data...

  • Big Data Engineer

    3 months ago


    Bengaluru, India Tavant Full time

    Key Responsibilities :- Design and implement scalable and efficient data processing pipelines using Apache Spark and Java.- Develop APIs and services for data ingestion, transformation, and aggregation to support analytics and machine learning models.- Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements and...

  • Big Data Architect

    4 weeks ago


    Bengaluru, Karnataka, India Expertia AI Full time

    Job Description:We are seeking a highly skilled Big Data Architect to join our team at Expertia AI. This is a unique opportunity for a talented professional to take their career to the next level.About the Role:The successful candidate will design and implement scalable big data transformations and pipelines, leveraging cloud platforms like Azure...


  • Bengaluru, India Damco Solutions Full time

    Position – Big Data Engineer with DevopsExp - 6-10 YrsJob Location- Bangalore ( 3 days hybrid working )Job DescriptionAs a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced...

  • Big Data Engineer

    7 days ago


    Bengaluru, Karnataka, India Wipro Full time

    Job Summary:We are seeking a highly skilled Big Data Engineer to join our team at Wipro. This is a fantastic opportunity for individuals with expertise in designing, building, and maintaining large-scale data processing systems.About the Role:The ideal candidate will have hands-on experience with big data technologies such as Hadoop, Spark, and Kafka. You...


  • Bengaluru, India Tiger Analytics Full time

    Job Description Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, our + tribe is solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you’ll find our...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using Databricks on AWS.Job Responsibilities:Design and develop efficient data pipelines using Apache Spark and Databricks.Ingest data from multiple...

  • Big data Engineer

    3 weeks ago


    Bengaluru / Bangalore, Gurgaon / Gurugram, India Talodyn Networks Private Limited Full time

    DescriptionWe are looking for an experienced Big Data Engineer to join our team. The ideal candidate will have 5-8 years of experience in the job market in India and will be responsible for designing, building, and maintaining our big data infrastructure. The candidate should have strong technical skills and experience working with big data technologies such...

  • Big Data Engineer

    6 months ago


    Bengaluru, India Adobe Full time

    Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Big data engineer

    1 month ago


    Bengaluru, India Mercedes-Benz Full time

    Tätigkeitsbereich:Forschung & Entwicklung incl. DesignFachabteilung:Data Analytics @ GCSPGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India, BangaloreStartdatum:..4Veröffentlichungsdatum:..4Stellennummer:MER3GEIArbeitszeit:Vollzeit BewerbenAufgaben · Mandatory: Deep hands-on...

  • Big Data Engineer 3

    1 month ago


    Bengaluru, Karnataka, India Oracle Full time

    Job SummaryWe are seeking an experienced Big Data Engineer to join our team at Oracle. This role involves designing, developing, and troubleshooting large-scale data systems.Key ResponsibilitiesDesign and implement data processing pipelines using Big Data technologiesDevelop and maintain large-scale data storage systemsCollaborate with cross-functional teams...

  • Data Engineer II

    2 weeks ago


    Bengaluru, India Prime Search Consultant Full time

    Data Engineer - SDE II(Java, Python, ETL, GCP, Big Data)Experience Required: 4 - 8 yearsMandatory (Company) - Product Companies ONLYMaximum Notice Period 30 DaysWorking Days: 5 days/weekOffice Location: Mumbai, BengaluruRole & Responsibilities :- Architect, Plan and Develop our data strategy and work with our team to turn it into working software.- Co-create...