Data Engineer
1 month ago
We are looking for Data Engineers(with GCP) at NucleusTeq with below skillset :
Mandatory Skill Set : Apache Spark, Hive, Hadoop, BigQuery, BigTable, Cloud Composure, Dataflow, Google Cloud Storage, Python, SQL, Shell Scripting, Git.
Good to have Skill Set : CI/CD, Jenkins, Security and Networking, Scala, GCP Identity and Access Management (IAM).
Responsibilities :
- Data Processing: Design, develop, and maintain scalable and efficient data processing pipelines using technologies such as Apache Spark, Hive, and Hadoop.
- Programming Languages: Proficient in Python, Scala, SQL, and Shell Scripting for data processing, transformation, and automation.
- Cloud Platform Expertise: Hands-on experience with Google Cloud Platform (GCP) services, including but not limited to BigQuery, BigTable, Cloud Composer, Dataflow, Google Cloud Storage, and Identity and Access Management (IAM).
- Version Control and CI/CD: Implement and maintain version control using Git and establish continuous integration/continuous deployment (CI/CD) pipelines for data processing workflows.
- Jenkins Integration: Experience with Jenkins for automating the building, testing, and deployment of data pipelines.
- Data Modeling: Work on data modeling and database design to ensure optimal storage and retrieval of data.
- Performance Optimization: Identify and implement performance optimization techniques for large-scale data processing.
- Collaboration: Collaborate with cross-functional teams, including data scientists, analysts, and other engineers, to understand data requirements and deliver solutions.
- Security and Networking: Possess basic knowledge of GCP Networking and GCP IAM to ensure secure and compliant data processing.
- Documentation: Create and maintain comprehensive documentation for data engineering processes, workflows, and infrastructure.
Qualifications :
- Proven experience with Apache Spark, Hive, and Hadoop.
- Strong programming skills in Python, Scala, SQL, and Shell Scripting.
- Hands-on experience with GCP services, including BigQuery, BigTable, Cloud Composer, Dataflow, Google Cloud Storage, and Identity and Access Management (IAM)
- Familiarity with version control using Git and experience in implementing CI/CD pipelines.
- Experience with Jenkins for automating data pipeline processes.
- Basic understanding of GCP Networking.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
-
Aptus Data Labs
2 weeks ago
Bangalore, India Aptus Data Labs Full timeAptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...
-
Aptus Data Labs
4 weeks ago
bangalore, India Aptus Data Labs Full timeAptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...
-
Aptus Data Labs
3 weeks ago
Bangalore, Karnataka, India Aptus Data Labs Full timeAptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...
-
Data Engineer
1 week ago
bangalore, India ANZ Full timeAbout the role Data Engineer – Role Type – FTE Job Grade: Group 4.3 At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia Commercial tribe. The Australia Data tribe sits within our Australia Commercial division and our mission is...
-
Data Engineer, IN Data Engineering
1 month ago
bangalore, India ADCI - Karnataka Full timeIN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses.IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing Unified...
-
Data Engineer
3 days ago
bangalore, India SMARTBORN SOFTWARE CONSULTING PVT.LTD. Full timeRole Description This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehousing, and data analytics. The role is based in Bengaluru, with flexibility for...
-
Data Engineer
1 week ago
bangalore, India Australia and New Zealand Banking Group Limited (ANZ) Full timeData Engineer Data Engineer Req ID: Department: Commercial Data & Analytics Division: Australia Commercial Location: Bengaluru About the role Data Engineer – Role Type – FTE Job Grade: Group 4.3 At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join...
-
Data Engineer
1 month ago
bangalore, India Analog Devices Full timeGather business and functional requirements and translate into robust scalable, solutions aligned to the Data Architecture guidelines Hands on development work on all aspects of data analysis, data provisioning, Data modeling, performance tuning and optimization Design, implement and operate large scale, high volume, high performance data structures for...
-
Data Engineer
8 hours ago
bangalore, India Joveo Full timeRole: Data Engineer Location: Hybrid (Bangalore/Hyderabad) About Joveo Joveo was founded in 2017 by a group of visionary entrepreneurs and enthusiastic problem solvers who foresaw the need for greater transparency and predictability in recruitment marketing. The focus was on building a cutting-edge technology platform that uses data and...
-
Data Engineer
1 week ago
bangalore, India Aryng Full timeWelcome! You made it to the job description page! Aryng is looking for a Senior Data Engineer with experience in developing enterprise-class distributed data engineering solutions on the cloud. We are seeking an entrepreneurial and technology-proficient Data Engineer who is an expert in theimplementation of a large-scale, highly efficient data platform,...
-
Data Engineer
4 weeks ago
bangalore, India Yara Full timeResponsibilities Participate in designing and building data pipelines to collect, manage and store data across different solutions and tools where the data resides for the YAA teams. Monitor, manage and maintain data pipelines as part of the day-to-day data operations. Build data mart tables for various use cases by working with the different data...
-
Data Engineer
1 month ago
Bangalore, India Magna Hire Full timeResponsibilities : Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards. Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases. Assist senior team members in optimizing dbt models and...
-
Data Engineer
3 weeks ago
Bangalore, Karnataka, India Magna Hire Full timeResponsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...
-
Data Engineer
8 hours ago
bangalore, India RaaGaa Value Add Technologies. Full timeKey Responsibilities: 1.Design, develop, and maintain scalable data pipelines and ETL processes to extract, transform, and load large volumes of structured and unstructured data from diverse sources in Batch and Real-time processing. 2.Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to...
-
Aptus Data Labs
1 month ago
bangalore, India Aptus Data Labs Full timeAptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Fresher- Frontend : BangaloreJob Description : Qualifications : - Bachelor's degree in computer science, MIS, or related discipline required (2023/2024 passed out) - knowledge in developing modular...
-
Aptus Data Labs
3 weeks ago
Bangalore, Karnataka, India Aptus Data Labs Full timeAptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Fresher- Frontend : BangaloreJob Description :Qualifications :- Bachelor's degree in computer science, MIS, or related discipline required (2023/2024 passed out)- knowledge in developing modular...
-
Aptus Data Labs
2 weeks ago
Bangalore, India Aptus Data Labs Full timeAptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Fresher- Frontend : BangaloreJob Description : Qualifications : - Bachelor's degree in computer science, MIS, or related discipline required (2023/2024 passed out) - knowledge in developing...
-
Bangalore/Bhopal, IN TekEinstein Pvt Ltd. Full timeExcellent opportunity to work with our MNC ClientImmediate joiners preferredSoftware Engineer (Professional Services - PS Engineers) Education : BE / B.Tech / MCA / MS - IT / CSTechnology : OLAP, HadoopExperience : 3-10 YearsLocation : Bangalore, IndoreRequirement :Hands on experience in working with following :- OLAP, Data warehousing ,ETL- Hadoop ecosystem...
-
Bangalore,Bhopal, India TekEinstein Pvt Ltd. Full timeExcellent opportunity to work with our MNC ClientImmediate joiners preferredSoftware Engineer (Professional Services - PS Engineers) Education : BE / B.Tech / MCA / MS - IT / CSTechnology : OLAP, HadoopExperience : 3-10 YearsLocation : Bangalore, IndoreRequirement :Hands on experience in working with following :- OLAP, Data warehousing ,ETL- Hadoop ecosystem...
-
Data Engineer
1 month ago
bangalore, India Recro Full timeJob Description:We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in data engineering, with a focus on Google Cloud Platform (GCP), particularly BigQuery, data integration, and building robust data pipelines. This role will involve working with various data sources, designing data models, and...