Data Engineer
2 months ago
PFB JD for Data Engineer -
Essential capabilities
Advanced or demonstrable experience in SQL, Python,
Experience with Source code control (GitHub) and Jenkins
Ability to design, develop, execute, complete ETL
Ability to articulate complex technical issues and desired outcomes of system enhancements
- Proven analytical skills and evidence-based decision making
- Excellent problem solving, troubleshooting & documentation skills
- Strong written and verbal communication skills
- Excellent collaboration and interpersonal skills
- Strong delivery focus with an active approach to quality and auditability
Desired Capabilities
- Experience with Artifactory and Jenkins for deployment of Production code
- Knowledge and exposure to Big Data technologies Hadoop stack such as HDFS, Hive, Impala, Spark etc, and cloud Big Data warehouses - RedShift, DataBricks.
- Exposure to AWS technologies including EMR, Glue, Athena, Data Pipeline, Lambda
- Exposure to technologies such as Airflow, GSC, GitHub
Experience
Hands on in SQL and its Big Data variants (Hive-QL, DataBricks ANSI, Redshift SQL)
It is expected that the role holder will most likely have the following qualifications and experience
- 4+ years technical experience (within financial services industry preferred)
- Solid experience, knowledge and skills in Data Engineering, BI/software development such as ELT/ETL, data extraction and manipulation in Data Lake/Data Warehouse/Lake House environment.
- Hands on programming experience in writing Python, SQL, Unix Shell scripts, Pyspark scripts, in a complex enterprise environment
- Experience in configuration management using Ansible/Jenkins/GIT
- Hands on experience of using AWS Services - S3,EC2, EMR, SNS, SQS, Lambda functions, Redshift
- Experience with Source Control Tools Github or BitBucket
- Skilled in querying data from a range of data sources that store structured and unstructured data Knowledge or understanding of Power BI (Recommended )
-
Data Engineer
2 months ago
gurugram, India Nutrabay Full timeWe are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...
-
Data Engineer/Senior Data Engineer
1 month ago
Gurugram, India Cognitio Analytics Inc Full timeExperience:1 to 8 years - DE/ Sr. DE/ AM /ManagerMust Have:SQLPython/ Pyspark Azure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, BitBucket, Version control, Azure DevOpsETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data SecurityAgile Practices, SDLCData Exploration, Data Quality metrics, Historical data Management, Good...
-
Data Engineer/Senior Data Engineer
1 month ago
Gurugram, India Cognitio Analytics Inc Full timeExperience: 1 to 8 years - DE/ Sr. DE/ AM /Manager Must Have: SQL Python/ Pyspark Azure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, BitBucket, Version control, Azure DevOps ETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data Security Agile Practices, SDLC Data Exploration, Data Quality metrics, Historical data...
-
Data Engineer
1 month ago
Gurugram, India Aays Full timePosition : Senior Data Engineer / Data Engineer Desired Experience : 3+ years You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a...
-
Data Engineer
1 month ago
Gurugram, India Aays Full timePosition: Senior Data Engineer / Data Engineer Desired Experience: 3+ years You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a...
-
Data Engineer
1 month ago
Gurugram, India Aays Full timePosition: Senior Data Engineer / Data Engineer Desired Experience: 3+ years You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a...
-
Data Engineer
7 months ago
Gurugram, India Nutrabay Full timeWe are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...
-
Data Engineer
2 weeks ago
Gurugram, India Straive Full timeJob Title: Data Engineer Location: Hyderabad/Bangalore/Gurgaon Job Type: Full time Years of Experience- 6-11 years About Straive: Straive is a market leading Content and Data Technology company providing data services, subject matter expertise, & technology solutions to multiple domains. Data Analytics & Al Solutions, Data Al Powered Operations and...
-
Data Engineer
6 months ago
Gurugram, India Nutrabay Full timeWe are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...
-
Data Engineer
6 months ago
Gurugram, India Nutrabay Full timeWe are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...
-
Data Engineer
2 months ago
gurugram, India Nutrabay Full timeWe are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...
-
Data Engineer
2 months ago
Gurugram, India IGT Solutions Full timeJob Overview:Data Engineer(Immediate Joiners Preferred)Exp:7+ YearsThe Data Engineer will work closely with other members of the data team to ensure data is properly ingested, cleaned, and stored for future analysis. He/she will take requirements from the reporting & business analysis team (product owner and reporting specialists) and create the appropriate...
-
Data Engineer
2 months ago
Gurugram, India IGT Solutions Full timeJob Overview:Data Engineer(Immediate Joiners Preferred)Exp:7+ YearsThe Data Engineer will work closely with other members of the data team to ensure data is properly ingested, cleaned, and stored for future analysis. He/she will take requirements from the reporting & business analysis team (product owner and reporting specialists) and create the appropriate...
-
Data Engineer
2 months ago
Gurugram, India IGT Solutions Full timeJob Overview: Data Engineer(Immediate Joiners Preferred) Exp:7+ Years The Data Engineer will work closely with other members of the data team to ensure data is properly ingested, cleaned, and stored for future analysis. He/she will take requirements from the reporting & business analysis team (product owner and reporting specialists) and create the...
-
Data Engineer
1 month ago
Gurugram, India SourceBae Full timePosition: Data Engineer Experience Level: 3-5 Years Location: Hybrid (3 days onsite per month at CyberHub, Gurgaon) Must-Have Skills: PySpark Azure Azure Data Factory (ADF) Databricks ETL Processes SQL Good-to-Have Skills: Change Management Tools DevOps Role Description: We are looking for a skilled Data Engineer to design and build robust data...
-
Data Engineer
1 month ago
Gurugram, India SourceBae Full timePosition: Data EngineerExperience Level: 3-5 YearsLocation: Hybrid (3 days onsite per month at CyberHub, Gurgaon)Must-Have Skills:PySparkAzureAzure Data Factory (ADF)DatabricksETL ProcessesSQLGood-to-Have Skills:Change Management ToolsDevOpsRole Description:We are looking for a skilled Data Engineer to design and build robust data solutions. In this role,...
-
Data Engineer
2 weeks ago
Gurugram, India Undisclosed Full timeLocation The successful candidate shall be placed at any of our Client's location in Gurugram, Haryana. It is a Full-time Job, “No” remote work. Data Engineers willing to work full-time in Python/PySpark and have deep knowledge of ETL tools, Large Databases and SQL may apply. Key Responsibilities Design, build, and maintain scalable data pipelines...
-
Data Engineer
3 weeks ago
Gurugram, India Aptita Full timeAbout the Role: Experience - 5 to 11 Years Notice Period - Immediate to 2 Month Location - Gurgaon,Bangalore Skill – Azure (Azure Data Factory, Azure Databricks, Data Stage, Airflow), SQL/Python, Rest API) and maintain Data Warehousing/Data Lakes/Data Hubs and analytical reporting environment Partner with technical and non-technical teams to understand...
-
Data Engineer
1 month ago
Gurugram, India IGT Full timeExciting Opportunity for the role of Data Engineer(Immediate joiners preferred)Exp:3+ YearsKey Responsibilities:Design, develop, and maintain scalable data pipelines using Python and PySpark.Work with SQL and MongoDB to manage and query large datasets.Develop and implement solutions using Snowflake for data warehousing.Leverage AWS services such as S3, Glue,...
-
Data Engineer
1 month ago
Gurugram, India IGT Full timeExciting Opportunity for the role of Data Engineer(Immediate joiners preferred)Exp:3+ YearsKey Responsibilities:Design, develop, and maintain scalable data pipelines using Python and PySpark.Work with SQL and MongoDB to manage and query large datasets.Develop and implement solutions using Snowflake for data warehousing.Leverage AWS services such as S3, Glue,...