Data Engineer
4 weeks ago
ETL- Hadoop
Role and Responsibilities :
- Design Extract/Load/Transform (ETL) workflows to develop large scale data structures and pipelines to organize, collect and standardize data
- Uses knowledge of Hadoop architecture, HDFS commands and experience in designing, optimizing queries to build data pipelines
- Integrate data from a variety of sources, assuring that they adhere to data quality and accessibility standards
- Implemented endpoints to read data from BigQuery and Hive
- To provide user-defined functions for clients to read data from Hive and BigQuery directly without using any external connector jars
- Collaborate with data science team to transform data and integrate algorithms and models into automated processes using programming skills - Python or Hive
- Help in optimizing queries, and work to integrate the business requirements into existing campaign reporting data workflows
- Design and implement scalable, configurable and self-learning marketing campaign platform
Candidate Profile :
- Bachelor's degree in Engineering/Computer Science or related quantitative field
- Significant of advanced experience with data analysis, reporting and programming logic (Python, PySpark, Hive, SQL, shell scripting)
- Experience interacting with decision-making business audience
- Analyzes current information technology environment to identify and access critical capabilities and recommend solutions
- Experiments with available tools and advices on new tolls in order to determine optimal solutions given the requirements dictated by the model/use case
- Good software engineering fundamentals, strong problem solving and critical thinking ability.
-
Senior Data Engineer
1 month ago
Bangalore/Chennai/Hyderabad/Pune, IN Capabiliq IT Services Private Limited Full timeAs a Senior Data Engineer, you will work to solve some of the organizational data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual Contributor, team member and Data Modeling lead as demanded by each project to define, design, and deliver actionable insights.On a typical day, you might...
-
Data Engineer
1 month ago
Mumbai/Bangalore/Pune/Chennai/Hyderabad, IN Changeleaders Full timeCompany Overview :Tech Mahindra is a leading provider of digital transformation, consulting, and business re-engineering services and solutions. We leverage next-generation technologies to help our clients achieve their business objectives.Job Summary :We are looking for an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will be...
-
Data Engineer
4 weeks ago
Chennai/Bangalore/Pune/Hyderabad/Noida, IN MNR Solutions Full timeJob Description :We are looking for an experienced AWS Data Engineer to join our team. The ideal candidate will have extensive knowledge of AWS data services and a strong background in data engineering. This role involves designing, implementing, and maintaining data pipelines and architectures to support business intelligence and analytics initiatives.Key...
-
AWS Data Engineer
1 month ago
Bangalore/Chennai/Hyderabad/Pune, IN MNR Solutions Full timeJob Description :We are looking for an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will have over 9 years of experience and strong expertise in AWS services, especially AWS RDS, data formats like JSON, CSV, XML, and hands-on experience in QlikSense and SQL.Key Responsibilities :- Design, develop, and optimize data pipelines...
-
Azure Data Engineer
1 month ago
Pune/Hyderabad/Bangalore/Chennai, IN BSRI Solutions Full timeJob Description :We are seeking a talented and experienced Azure Data Engineer to join our team. The ideal candidate will have a strong background in data engineering with a focus on Microsoft Azure services. The candidate should have a minimum of 5-10 years of hands-on experience with Azure Data Factory (ADF), Azure Synapse Analytics, Synapse Pipelines,...
-
Nuviso Networks
1 month ago
Hyderabad/Chennai/Bangalore, IN Nuviso Networks Full time1. Data Engineering & Development :- Design, develop, and maintain scalable data pipelines using Azure Databricks.- Implement ETL processes to ingest and transform data from various sources.2. Data Management :- Develop and maintain Delta Lake tables for efficient data storage and retrieval.- Ensure data quality and integrity through rigorous testing and...
-
Data Engineer
1 month ago
Hyderabad/Chennai/Bangalore/Delhi/Kolkata/Mumbai/Pune, IN MLOPS SOLUTIONS PRIVATE LIMITED Full timeJob Title : GCP Data EngineerExperience : 6-8 YearsLocations : Hyderabad, Chennai, Bangalore, Pune, Mumbai,, Kolkata & DelhiNotice period: 15 DaysWork mode : Hybrid (2 Days work from office)Job type : FTE/C2HRole Description :We are seeking an experienced GCP Data Engineer with 6-8 years of experience to join our team. The ideal candidate will be responsible...
-
Senior Azure Data Engineer
1 month ago
Bangalore/Pune/Chennai/Hyderabad, IN Foundit Full timeJob Description :Tech Skills Required :- Minimum 5 years of experience with Azure development and data solutions.- High proficiency with Azure data technologies (Azure Data Factory, Databricks, Azure Synapse Analytics).- Strong proficiency in SQL and writing complex data queries.- Deep experience in all stages of Data Analysis, including data source...
-
Data Engineer
6 months ago
Mumbai/Bangalore/Hyderabad/Chennai/Pune/Delhi, IN VARITE Inc. Full timeJob Title: Data EngineerLocation City : Hyderabad, bangalore, chennai, mumbai, new delhi, pune.Experience Required : 4+Shift: Day ShiftWork Mode: OnsitePosition Type: ContractOpenings: 3Company Name : VARITE INDIA PRIVATE LIMITEDAbout The Client: A multinational technology and e-commerce company based in the United States is widely recognized as one of the...
-
Data Engineer
1 month ago
Hyderabad/Pune, IN Selsoft Full timeSalary : 27-41 LPARole : Data : 5.5 years to 13 yearsLocation : HyderabadKey Skills : Python, Pyspark, Spark, Kafka, AWS Glue and other AWS servicesJob Description :- 5+ to 13 years of relevant work experience showing growth as a Data Engineer.- Hands On programming experience- Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.-...
-
Senior Data Engineer
1 month ago
Bangalore/Hyderabad/Chennai, IN InstaTalent Recruit LLP Full timeJob Description :Job Title : Senior Data Engineer - SynapseLocation : Bengaluru, Chennai, HyderabadExperience : 7 to 10 YearsEmployment Type : Full-timeMust Have Skills : Azure Synapse, Azure, Azure Datalake, ADF, Azure your typical day would look like :As a Senior Data Engineer, you will have the opportunity to solve some of the most captivating data...
-
Senior Data Engineer
1 month ago
Chennai/Hyderabad/Bangalore, IN INUMELLAS CONSULTANCY SERVICES PRIVATE LIMITED Full timeJob Title : Senior Data Engineer - DBTLocation : Chennai , Hyderabad , BangaloreWho we are :Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer :Fullstack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission to...
-
Data Visualization Engineer
4 weeks ago
Bangalore/Pune, IN MaimsD Technology Full timeRole : Data Visualization EngineerLocation : Bangalore, PuneExperience : 4 - 7 YrsEmployment Type : Full Time, PermanentWorking mode : RegularNotice Period : Immediate - 15 DayAbout the Role :We are seeking a skilled Data Visualization Engineer to join our team and transform raw data into actionable insights. You will play a crucial role in designing,...
-
BI Tableau Engineer
4 weeks ago
Bangalore/Hyderabad/Delhi/Kolkata, IN Freelance Full timeJob DescriptionSenior resource with minimum 2-8 Years of experience in Tableau.- Very strong experience on Tableau Functions, Tableau Data Prep and Tableau Visuals.- Good experience on end-to-end Enterprise BI development & deployment.- Developing data Models, Data Preparation with Data Flows and designing BI reports- Proven experience in writing advanced...
-
Senior Data Engineer
1 month ago
Bangalore/Karnataka/Pune/Hyderabad, IN InstaTalent Recruit LLP Full timeJob Description :As a Senior Data Engineer, you will work to solve some of the most complex and captivating data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual Contributor, team member, and Data Modeling Architect as demanded by each project to define, design, and deliver actionable...
-
Bangalore/Hyderabad/Chennai, IN Technogen India Private Limited Full timeWe are looking for data engineers who can work with world class team members to help drive telecom business to its full potential . We are building data products / assets for telecom wireless and wireline business which includes consumer analytics, telecom network performance and service assurance analytics etc. We are working on cutting edge technologies...
-
Data Engineer
1 month ago
Delhi NCR/Bangalore/Hyderabad/Chennai, IN ANLAGE Full timeJob Overview : We are seeking a highly skilled and motivated Scala Data Engineer to join our team. In this role, you will design, build, and maintain large-scale data processing systems. The ideal candidate will have a strong background in Scala programming, distributed data processing frameworks, and a deep understanding of data architecture and pipelines....
-
Azure Data Engineer
1 month ago
Anywhere in India/Multiple Locations/Mumbai/Bangalore/Hyderabad/Kolkata/Chennai/Pune/Bhubaneshwar/Na, IN Talpro Full timeJob Description : We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL. As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure SQL....
-
GCP Data Engineer
1 month ago
Bangalore/Hyderabad/Chennai, IN TechnoGen India Private Limited Full timeWhat you'll be doing :As a Data Engineer with ETL/ELT expertise for our growing data platform and analytics teams, you will understand and enable the required data sets from different sources. You will take both structured and unstructured data into our data warehouse and data lake with real-time streaming and/or batch processing to generate insights and...
-
Data Engineer
1 month ago
Bangalore/Pune, IN Qualite Manpower Full timeRole : GCP Data Engineer Experience :- 5+ years of experience in data engineering, with a focus on cloud-based solutions.- Extensive experience with Google Cloud Platform (GCP) and its data services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer.- Proven track record of designing and building scalable data pipelines and...