Damco Solutions | Big Data Engineer with Devops | bangalore
4 weeks ago
Position – Big Data Engineer with Devops
Exp - 6-10 Yrs
Job Location- Bangalore ( 3 days hybrid working )
Job Description
As a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline designer and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will lead our software developers on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.
Responsibilities
- Create and maintain optimal data pipeline architecture
- Assemble large complex data sets that meet functional / non-functional business requirements.
- Identify design and implement internal process improvements: automating manual processes optimizing data delivery, coordinating to re-design infrastructure for greater scalability etc.
- Work with stakeholders including the Executive Product Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Keep our data separated and secure
- Work with data and analytics experts to strive for greater functionality in our data systems.
- Support PROD systems
Qualifications
- Must have About 6 - 11 years and at least 3 years relevant experience with Bigdata.
- Must have Experience in building highly scalable business applications, which involve implementing large complex business flows and dealing with huge amount of data.
- Must have experience in Hadoop, Hive, Spark with Scala with good experience in performance tuning and debugging issues.
- Hands-on experience in one of the cloud provider (AWS/Azure) is must
- Good to have any stream processing Spark/Java Kafka.
- Must have experience in design and development of Big data projects.
- Good knowledge in Functional programming and OOP concepts, SOLID principles, design patterns for developing scalable applications.
- Familiarity with build tools like Maven.
- Must have experience with any RDBMS and at least one NoSQL database preferably PostgresSQL
- Must have experience writing unit and integration tests using scaliest
- Must have experience using any versioning control system - Git
- Must have experience with CI / CD pipeline – Jenkins is a plus
- Databricks Spark certification is a plus.
-
bangalore, India Damco Solutions Full timePosition – Big Data Engineer with DevopsExp - 6-10 YrsJob Location- Bangalore ( 3 days hybrid working )Job DescriptionAs a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced...
-
bangalore, India Damco Solutions Full timePosition – Big Data Engineer with DevopsExp - 6-10 YrsJob Location- Bangalore ( 3 days hybrid working )Job DescriptionAs a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate is an experienced...
-
Damco Solutions | Synon Developer | bangalore
1 month ago
bangalore, India Damco Solutions Full timePosition - Synon DeveloperExperience - 7+ yearsLocation - Bangalore, Gurugram, NoidaQualifications:Minimum 6+ years of experience across the entire enterprise data center stack from the hardware to the application layer at major consulting firm or systems integrator.Strong SYNON development experience.Experience in AS400 & RPGLE and RPG...
-
Big data engineer with devops
2 weeks ago
Bangalore, India Damco Solutions Full timePosition – Big Data Engineer with Devops Exp - 6-10 Yrs Job Location- Bangalore ( 3 days hybrid working ) Job Description As a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate...
-
Damco Solutions | Azure DevOps Engineer
2 weeks ago
bangalore, India Damco Solutions Full timePosition Title: Azure DevOps EngineerExperience: 7- 10 yearsLocation: Bangalore, Noida, GurugramJob Description:Skills & Qualifications:Experience: 7-10 years of experience as a DevOps Engineer with significant hands-on experience in Azure cloud services .Strong expertise in Azure cloud platforms (e.g., Azure Virtual Machines , Azure Storage , Azure...
-
Synon Developer
1 month ago
Bangalore, India Damco Solutions Full timePosition - Synon Developer Experience - 7+ years Location - Bangalore, Gurugram, Noida Qualifications: Minimum 6+ years of experience across the entire enterprise data center stack from the hardware to the application layer at major consulting firm or systems integrator. Strong SYNON development experience. Experience in AS400 & RPGLE and...
-
Senior Data Engineer
4 weeks ago
Bangalore, India Visionyle Solutions Full timeTitle : Senior Data EngineerExperience : 6+ YearsNotice Period : Immediate to 15 Days (Serving NP candidates)Work Location - BangaloreMandatory skills : Big data applications, Spark, python, scala , AWS S3,Airflow,Data bricks, data platforms, Jenkins, CICD PipelinesRequirements :- 6+ years of experience in developing scalable Big Data applications or...
-
bangalore, India krtrimaIQ Cognitive Solutions Full timeJob Title: Azure Databricks EngineerLocation: BangaloreExperience Level: 5+ years of relevant experienceEmployment Type: Full-TimeAbout Us:Join our team to help shape the future of data solutions! We are looking for a skilled Azure Data Engineer to work on cutting-edge projects, transforming large-scale data and enabling data-driven insights for our...
-
NeerInfo Solutions | DevOps Engineer | bangalore
4 weeks ago
bangalore, India NeerInfo Solutions Full timeHiring for Fortune IT CompanyRole: DevOpsExperience: 7.5 to 10 YearsLocation: BangaloreJD:Understanding customer requirements and project KPIs.Managing stakeholders and external interfaces.Defining and setting development, test, release, update, and support processes for DevOps operation.Troubleshooting techniques and fixing the code bugs.Identifying and...
-
Azure devops engineer
2 weeks ago
Bangalore, India Damco Solutions Full timePosition Title: Azure Dev Ops Engineer Experience: 7- 10 years Location: Bangalore, Noida, Gurugram Job Description: Skills & Qualifications: Experience: 7-10 years of experience as a Dev Ops Engineer with significant hands-on experience in Azure cloud services . Strong expertise in Azure cloud platforms (e.g., Azure Virtual...
-
NeerInfo Solutions | DevOps Engineer | bangalore
4 weeks ago
bangalore, India NeerInfo Solutions Full timeHiring for Fortune IT Company Role: DevOps Experience: 7.5 to 10 Years Location: Bangalore JD: Understanding customer requirements and project KPIs. Managing stakeholders and external interfaces. Defining and setting development, test, release, update, and support processes for DevOps operation. Troubleshooting techniques and fixing the code bugs....
-
Big Data Developer
3 months ago
Bangalore City, India Tata Consultancy Services Full timeGreetings from TCS!TCS is hiring for Big Data DeveloperDesired Experience: 5+ YearsJob Location: Chennai/ Bangalore / Pune / MumbaiRequire skillset: Big Data, Hadoop, Spark, Scala, HiveJob Description:-Must Have Technical Qualifications:SparkHadoopHiveScalaNice to Have Qualifications: Data Engineer CertificationExperience with Apache Beam.Technical...
-
Big data engineer
2 weeks ago
Bangalore, India Capco Full timeJob Title: Big Data Engineer About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount . With our presence across 32 cities across globe, we support 100+ clients...
-
Big data developer
2 weeks ago
Bangalore, India Impetus Full timeBig Data Developer Experience- 3 to 12 years Locations- Indore, Noida, Hyderabad, Bangalore, Gurgaon Job Description We are looking for a Big Data Developer to design and oversee the implementation of large-scale data solutions, lead a talented team, and ensure the efficient processing and analysis of massive datasets. Roles &...
-
LTIMindtree | Big Data Specialist | bangalore
3 weeks ago
bangalore, India LTIMindtree Full timePlease fill this form for quick response:-fill this: - if it is not opening you can paste it on google and fill it.Experience Range - 5 to 12 yrsSkills - Big Data- Scala SparkJob Location: Bangalore, Chennai, Pune, Hyderabad, MumbaiScala Spark Job Description:Mainly Scala+Spark ex perience needed.5+ years of experienceExpertise in Data Engineering. Hands-on...
-
DevOps Engineer
4 weeks ago
Bangalore, India Tata Consultancy Services Full timeSkill name: DevOps IS Admin / OpenShift Admin Experience: 4 to 8 Years Location: Bangalore Job Description: 4+ years of hands-on DevOps engineer experience Hands on experience with artifact management cycle. In Particular GIT, JFrog, Jenkins. Versions releases and branch management. Automation development using Ansible, Terraform and Python. ...
-
Big Data Engineer
4 weeks ago
Bangalore, India Tavant Full timeKey Responsibilities :- Design and implement scalable and efficient data processing pipelines using Apache Spark and Java.- Develop APIs and services for data ingestion, transformation, and aggregation to support analytics and machine learning models.- Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements and...
-
bangalore, India Teamware Solutions Full timeGreetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. LtdWe are hiring an Azure DevOps engineerLocations: Bengaluru, Hyderabad, Mumbai, Kolkata, GurgaonHybrid; 2nd Shift 2-11 PMExperience: 5- 9 YearsNotice Period: Immediate to 15 daysAzure DevOps engineer - Bicep and TerraformAbout the Role:We are seeking an experienced Azure...
-
Data Engineer
4 weeks ago
Bangalore, India Coders Brain Technology Private Limited Full timeQualifications : - Bachelor's degree in Computer Science/Engineering or similar - 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines - Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure: Data...
-
Solution Engineer
4 weeks ago
Bangalore, India HEVO DATA Full timeOverview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will...