Data Engineer
3 weeks ago
Responsibilities for Data Engineer:
- Create and maintain optimal data pipeline architecture,.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
- Work with data and analytics experts to strive for greater functionality in our data systems.
Qualifications for Data Engineer:
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience building and optimizing 'big data' data pipelines, architectures and data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- A successful history of manipulating, processing and extracting value from large disconnected datasets.
- Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
- Strong project management and organizational skills.
- Experience supporting and working with cross-functional teams in a dynamic environment.
We are looking for a candidate with 3-5 years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
They should also have experience using the following software/tools:
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational SQL and NoSQL databases.
- Experience with data pipeline and workflow management tools.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Experience with object-oriented / object function scripting languages: Python, Java, C++, Scala, etc.
-
Aptus Data Labs
3 weeks ago
Bangalore, Karnataka, India Aptus Data Labs Full timeAptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...
-
Data Engineer
3 weeks ago
Bangalore, Karnataka, India Magna Hire Full timeResponsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...
-
Aptus Data Labs
3 weeks ago
Bangalore, Karnataka, India Aptus Data Labs Full timeAptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Fresher- Frontend : BangaloreJob Description :Qualifications :- Bachelor's degree in computer science, MIS, or related discipline required (2023/2024 passed out)- knowledge in developing modular...
-
Staff Engineer
3 weeks ago
Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full timeWe are urgently hiring for our client for the position of Staff Engineer - Data Engineering. Location : Anywhere in India.Np : max 30 days.What you'll do : As the Staff Engineer of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment. Staff...
-
Kafka Data Engineer
2 weeks ago
Bangalore, Karnataka, India Codersbrain technology pvt ltd Full timeMandatory skills : - Azure, Kafka, Data Engineering or any Data Platforms background- Experience with Azure/MS Data Platforms: Postgres Single and Flex, Azure SQL, MS SQL server, Kubernetes- Terraform (Preferred not Compulsory), Bicep or other IaC.- Helm (helm deployments as well writing charts).- Azure DevOps pipelines.- Engineer, Data Engineer, or similar...
-
Senior Data Engineer
3 weeks ago
Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full timeWe are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...
-
Data Engineer
3 weeks ago
Bangalore, Karnataka, India SKEP IT SYSTEMS Full timeRole : Data EngineerMobilution IT Systems is a pioneering organization at the forefront of technological innovation, specializing in cutting-edge Tech solutions. With a strong commitment to leveraging advanced technologies for scientific advancements, Mobilution IT Systems is dedicated to revolutionizing the way data is analysed and utilized across various...
-
Data Engineer
3 weeks ago
Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full timeCompany Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....
-
Senior Data Engineer
3 weeks ago
Bangalore, Karnataka, India Recrud Full timeRecrud is proud to partner with a dynamic SaaS startup to scout for a skilled Data Engineer, adept in crafting robust data pipelines.This role is integral to the client's team, demanding a candidate with a minimum of 5 years of dedicated experience in the field.Position Overview :The Data Engineer will be a crucial part of the startup's technical...
-
Azure Data Engineer
3 weeks ago
Bangalore, Karnataka, India Orange Shark Full timePosition : Azure Data EngineerExperience : 6-10 YearsNotice Period : Immediate to 15 DaysLocation : Bangalore.Primary Skills : Azure, DevOps, Azure Data Factory (Min. 4 Years ), Azure SQL/MS SQL.Job Description :We are seeking a skilled Azure Data Engineer to join our dynamic team. The ideal candidate will have hands-on experience designing, implementing,...
-
Python Data Engineer
2 weeks ago
Bangalore, Karnataka, India Cyitechsearch Full timeA Python Data Engineer job description typically includes the following responsibilities, qualifications, and skills:Job Description :Responsibilities :- Develop and maintain robust data pipelines to extract, transform, and load (ETL) data from various sources into data lakes, warehouses, or databases.- Design, build, and optimize data models and schemas to...
-
Senior Engineer
3 weeks ago
Bangalore, Karnataka, India Prudential Manpower Pvt.lTD Full timeImmediately hiring for our client for the role of Senior Engineer Data & Analytics. Total Exp : 8+ years. Location: Anywhere in India. What you'll do:As the senior manager of the data engineering team, you will be entrusted with the delivery of scalable services that empower our customers to maximize return on brand outreach and recruitment.- Data...
-
Director - Data Engineering
3 weeks ago
Bangalore, Karnataka, India Ethos HR Management & Projects Pvt. Ltd Full timeJob Description (Minimum 100 Characters) Your Responsibility :- Lead efforts in building and delivering the data strategy for data engineering. - Manage development and support of data fabric platform that caters to needs of real time events and batch data processing. - Manage end to end development of data products that include traditional RDBMS and big...
-
Senior Data Engineer
3 weeks ago
Bangalore, Karnataka, India Growel Softech Pvt. Ltd. Full timeJob Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...
-
Senior Data Engineer
3 weeks ago
Bangalore, Karnataka, India Muoro Full timeJob Description :About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions using...
-
Senior Data Engineer
3 weeks ago
Bangalore, Karnataka, India Amicon Hub Full timeData Engineer role.Location : BangaloreNeed only Immediate Joiners and candidates from Product based/Start up Companies.Responsibilities :- Analyze and organize raw data - Build data systems and pipelines- Evaluate business needs and objectives- Interpret trends and patterns- Conduct complex data analysis and report on results - Prepare data for prescriptive...
-
Software Engineer
2 weeks ago
Bangalore, Karnataka, India TalentXo Full timeWe are looking for a talented and motivated Software Engineer to join our growing Data Engineering & Analytics team. In this role, you will play a pivotal role in developing, maintaining, and improving our reporting products and data pipelines.Responsibilities :- Design and develop high-impact, user-facing features for our reporting products, leveraging your...
-
Data Engineer
3 weeks ago
Bangalore, Karnataka, India Excellence and Eminence LLP Full timeAbout the Role:We are seeking a talented and motivated Data Engineer to join our team and play a crucial role in building and maintaining our data infrastructure. This role is ideal for a candidate with a strong foundation in data engineering principles and experience working with data pipelines and Design, develop, and implement data pipelines for efficient...
-
Data Engineer
3 weeks ago
Bangalore, Karnataka, India Mobile Programming LLC Full timeJob Description :Please note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and ensuring the smooth operation of our data platforms. The ideal candidate should have a strong...
-
Azure Data Engineer
3 weeks ago
Bangalore, Karnataka, India Connectio IT Pvt Ltd Full timeRole Description :This is a full-time Azure Data Engineer role at Connect io IT Pvt Ltd located in Bengaluru. As an Azure Data Engineer, you will be responsible for tasks such as data engineering, data modeling, Extract Transform Load (ETL), data warehousing, and data analytics. You will work on-site in Bengaluru.Qualifications :- Data Engineering, Data...