Damco Solutions | Big Data Engineer with Devops | bangalore

4 weeks ago


bangalore, India Damco Solutions Full time

Position – Big Data Engineer with Devops

Exp - 6-10 Yrs

Job Location- Bangalore ( 3 days hybrid working )



Job Description

As a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline designer and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will lead our software developers on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.


Responsibilities

  • Create and maintain optimal data pipeline architecture
  • Assemble large complex data sets that meet functional / non-functional business requirements.
  • Identify design and implement internal process improvements: automating manual processes optimizing data delivery, coordinating to re-design infrastructure for greater scalability etc.
  • Work with stakeholders including the Executive Product Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Keep our data separated and secure
  • Work with data and analytics experts to strive for greater functionality in our data systems.
  • Support PROD systems


Qualifications

  • Must have About 6 - 11 years and at least 3 years relevant experience with Bigdata.
  • Must have Experience in building highly scalable business applications, which involve implementing large complex business flows and dealing with huge amount of data.
  • Must have experience in Hadoop, Hive, Spark with Scala with good experience in performance tuning and debugging issues.
  • Hands-on experience in one of the cloud provider (AWS/Azure) is must
  • Good to have any stream processing Spark/Java Kafka.
  • Must have experience in design and development of Big data projects.
  • Good knowledge in Functional programming and OOP concepts, SOLID principles, design patterns for developing scalable applications.
  • Familiarity with build tools like Maven.
  • Must have experience with any RDBMS and at least one NoSQL database preferably PostgresSQL
  • Must have experience writing unit and integration tests using scaliest
  • Must have experience using any versioning control system - Git
  • Must have experience with CI / CD pipeline – Jenkins is a plus
  • Databricks Spark certification is a plus.



  • bangalore, India Damco Solutions Full time

    Position – Big Data Engineer with DevopsExp - 6-10 YrsJob Location- Bangalore ( 3 days hybrid working )Job DescriptionAs a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced...


  • bangalore, India Damco Solutions Full time

    Position – Big Data Engineer with DevopsExp - 6-10 YrsJob Location- Bangalore ( 3 days hybrid working )Job DescriptionAs a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced...


  • bangalore, India Damco Solutions Full time

    Position - Synon DeveloperExperience - 7+ yearsLocation - Bangalore, Gurugram, NoidaQualifications:Minimum 6+ years of experience across the entire enterprise data center stack from the hardware to the application layer at major consulting firm or systems integrator.Strong SYNON development experience.Experience in AS400 & RPGLE and RPG...


  • Bangalore, India Damco Solutions Full time

    Position – Big Data Engineer with Devops Exp - 6-10 Yrs Job Location- Bangalore ( 3 days hybrid working ) Job Description As a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate...


  • bangalore, India Damco Solutions Full time

    Position Title: Azure DevOps EngineerExperience: 7- 10 yearsLocation: Bangalore, Noida, GurugramJob Description:Skills & Qualifications:Experience: 7-10 years of experience as a DevOps Engineer with significant hands-on experience in Azure cloud services .Strong expertise in Azure cloud platforms (e.g., Azure Virtual Machines , Azure Storage , Azure...

  • Synon Developer

    1 month ago


    Bangalore, India Damco Solutions Full time

    Position - Synon Developer Experience - 7+ years Location - Bangalore, Gurugram, Noida Qualifications: Minimum 6+ years of experience across the entire enterprise data center stack from the hardware to the application layer at major consulting firm or systems integrator. Strong SYNON development experience. Experience in AS400 & RPGLE and...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, India Visionyle Solutions Full time

    Title : Senior Data EngineerExperience : 6+ YearsNotice Period : Immediate to 15 Days (Serving NP candidates)Work Location - BangaloreMandatory skills : Big data applications, Spark, python, scala , AWS S3,Airflow,Data bricks, data platforms, Jenkins, CICD PipelinesRequirements :- 6+ years of experience in developing scalable Big Data applications or...


  • bangalore, India krtrimaIQ Cognitive Solutions Full time

    Job Title: Azure Databricks EngineerLocation: BangaloreExperience Level: 5+ years of relevant experienceEmployment Type: Full-TimeAbout Us:Join our team to help shape the future of data solutions! We are looking for a skilled Azure Data Engineer to work on cutting-edge projects, transforming large-scale data and enabling data-driven insights for our...


  • bangalore, India NeerInfo Solutions Full time

    Hiring for Fortune IT CompanyRole: DevOpsExperience: 7.5 to 10 YearsLocation: BangaloreJD:Understanding customer requirements and project KPIs.Managing stakeholders and external interfaces.Defining and setting development, test, release, update, and support processes for DevOps operation.Troubleshooting techniques and fixing the code bugs.Identifying and...

  • Azure devops engineer

    2 weeks ago


    Bangalore, India Damco Solutions Full time

    Position Title: Azure Dev Ops Engineer Experience: 7- 10 years Location: Bangalore, Noida, Gurugram Job Description: Skills & Qualifications: Experience: 7-10 years of experience as a Dev Ops Engineer with significant hands-on experience in Azure cloud services . Strong expertise in Azure cloud platforms (e.g., Azure Virtual...


  • bangalore, India NeerInfo Solutions Full time

    Hiring for Fortune IT Company Role: DevOps Experience: 7.5 to 10 Years Location: Bangalore JD: Understanding customer requirements and project KPIs. Managing stakeholders and external interfaces. Defining and setting development, test, release, update, and support processes for DevOps operation. Troubleshooting techniques and fixing the code bugs....

  • Big Data Developer

    3 months ago


    Bangalore City, India Tata Consultancy Services Full time

    Greetings from TCS!TCS is hiring for Big Data DeveloperDesired Experience: 5+ YearsJob Location: Chennai/ Bangalore / Pune / MumbaiRequire skillset: Big Data, Hadoop, Spark, Scala, HiveJob Description:-Must Have Technical Qualifications:SparkHadoopHiveScalaNice to Have Qualifications: Data Engineer CertificationExperience with Apache Beam.Technical...

  • Big data engineer

    2 weeks ago


    Bangalore, India Capco Full time

    Job Title: Big Data Engineer About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount . With our presence across 32 cities across globe, we support 100+ clients...

  • Big data developer

    2 weeks ago


    Bangalore, India Impetus Full time

    Big Data Developer Experience- 3 to 12 years Locations- Indore, Noida, Hyderabad, Bangalore, Gurgaon Job Description We are looking for a Big Data Developer to design and oversee the implementation of large-scale data solutions, lead a talented team, and ensure the efficient processing and analysis of massive datasets. Roles &...


  • bangalore, India LTIMindtree Full time

    Please fill this form for quick response:-fill this: - if it is not opening you can paste it on google and fill it.Experience Range - 5 to 12 yrsSkills - Big Data- Scala SparkJob Location: Bangalore, Chennai, Pune, Hyderabad, MumbaiScala Spark Job Description:Mainly Scala+Spark ex perience needed.5+ years of experienceExpertise in Data Engineering. Hands-on...

  • DevOps Engineer

    4 weeks ago


    Bangalore, India Tata Consultancy Services Full time

    Skill name: DevOps IS Admin / OpenShift Admin Experience: 4 to 8 Years Location: Bangalore Job Description: 4+ years of hands-on DevOps engineer experience Hands on experience with artifact management cycle. In Particular GIT, JFrog, Jenkins. Versions releases and branch management. Automation development using Ansible, Terraform and Python. ...

  • Big Data Engineer

    4 weeks ago


    Bangalore, India Tavant Full time

    Key Responsibilities :- Design and implement scalable and efficient data processing pipelines using Apache Spark and Java.- Develop APIs and services for data ingestion, transformation, and aggregation to support analytics and machine learning models.- Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements and...


  • bangalore, India Teamware Solutions Full time

    Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdWe are hiring an Azure DevOps engineerLocations: Bengaluru, Hyderabad, Mumbai, Kolkata, GurgaonHybrid; 2nd Shift 2-11 PMExperience: 5- 9 YearsNotice Period: Immediate to 15 daysAzure DevOps engineer - Bicep and TerraformAbout the Role:We are seeking an experienced Azure...

  • Data Engineer

    4 weeks ago


    Bangalore, India Coders Brain Technology Private Limited Full time

    Qualifications : - Bachelor's degree in Computer Science/Engineering or similar - 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines - Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure: Data...

  • Solution Engineer

    4 weeks ago


    Bangalore, India HEVO DATA Full time

    Overview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will...