Bau data engineer
3 weeks ago
One of our clients is looking for BAU Data Engineer Consultant and would like to know your interest on the same.
JOB DESCRIPTION
Should be a Lead with min 4-8 members team management.
Mandatory Skills : AWS (S3, GLUE) , SNOWFLAKE , AIRFLOW , SQL, PYTHON/PYSPARK
Hands on exp in doing Production Support & willingness to work in Production Support
Key Skills:
Strong AWS knowledge in terms of designing new architecture and providing optimized solution for existing one.
In-depth knowledge with respect to Snowflake and its architecture.
provide solutioning and drive the implementation of DOPS features which includes - building IAC infra, Git Lab re-structuring, Git lab Upgrades monitoring etc.,
Should have the vision on data strategy and able to deliver the same.
Should be able to lead the design and implementation of data management processes, including data sourcing, integration, and transformation.
Able to manage and lead a team of data professionals, providing guidance, mentoring and foster a collaborative and innovative team culture focused on continuous improvement.
To evaluate and recommend data-related technologies, tools, and platforms.
Collaborate with IT teams to ensure seamless integration of data solutions.
should have experience in Implementing and enforce data security protocols and ensure compliance with relevant regulations.
Required Qualifications :
Experience as a Lead: 5+ years, should pose a strong character in leading a small team.
Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field.
At least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databases.
At least 5 years of recent hands-on professional experience (actively coding) working as a Lead handling support & production issues.
Professional experience working in an agile, dynamic and customer facing environment is required.
Understanding of distributed systems and cloud technologies (AWS) is highly preferred.
Understanding of data streaming and scalable data processing is preferred to have.
Experience with large scale datasets, data lake and data warehouse technologies such as AWS Redshift, Google Big Query, Snowflake. Snowflake is highly preferred.
Atleast 2+ years of experience in ETL (AWS Glue), Amazon S3, Amazon RDS, Amazon Kinesis, Amazon Lambda, Apache Airflows, Amazon Step Functions.
Strong knowledge in scripting languages like Python, UNIX shell and Spark is required.
Understanding of RDBMS, Data ingestions, Data flows, Data Integrations etc.
Technical expertise with data models, data mining and segmentation techniques.
Experience with full SDLC lifecycle and Lean or Agile development methodologies.
Knowledge of CI/CD and GIT Deployments.
Ability to work in team in diverse/ multiple stakeholder environment.
Ability to communicate complex technology solutions to diverse teams namely, technical, business and management teams.
Responsibilities :
Work with stakeholders to understand needs for data structure, availability, scalability, and accessibility.
Develop tools to improve data flows between internal/external systems and the data lake/warehouse.
Build robust and reproducible data ingest pipelines to collect, clean, harmonize, merge, and consolidate data sources.
Understanding existing data applications and infrastructure architecture
Build and support new data feeds for various Data Management layers and Data Lakes
Evaluate business needs and requirements.
Support migration of existing data transformation jobs in Oracle, and MS-SQL to Snowflake.
Lead the migration of the existing data transformation jobs in Oracle, Hive, Impala etc. into Spark, Python on Glue etc.
Able to document the processes and steps.
Develop and maintain datasets.
Improve data quality and efficiency.
Lead Business requirements and deliver accordingly.
Collaborate with Data Scientists, Architect and Team on several Data Analytics projects.
Collaborate with Dev Ops Engineer to improve system deployment and monitoring process.
Experience in critical production support and how the BAU functions is preferred.
Soft Skills
Ability to work in a collaborative environment and coach other team members on coding practices, design principles, and implementation patterns that lead to high-quality maintainable solutions.
Excellent communications and stake-holder management is required.
Ability to handle the senior leadership and report to them if required.
Ability to work in a dynamic, agile environment within a geographically distributed team.
Ability to focus on promptly addressing customer needs.
Ability to work within a diverse and inclusive team.
Technically curious, self-motivated, versatile and solution oriented.
If you are keen to explore the above role, please send across your updated resume to and we can discuss to proceed further
-
BAU Data Engineer
3 weeks ago
Hyderabad, India Helius Technologies Full timeHi,One of our clients is looking for BAU Data Engineer Consultant and would like to know your interest on the same.JOB DESCRIPTIONShould be a Lead with min 4-8 members team management.Mandatory Skills : AWS (S3,GLUE) , SNOWFLAKE , AIRFLOW , SQL, PYTHON/PYSPARKHands on exp in doing Production Support & willingness to work in Production SupportKey...
-
BAU Data Engineer
3 weeks ago
Hyderabad, India Helius Technologies Full timeHi,One of our clients is looking for BAU Data Engineer Consultant and would like to know your interest on the same.JOB DESCRIPTIONShould be a Lead with min 4-8 members team management.Mandatory Skills : AWS (S3,GLUE) , SNOWFLAKE , AIRFLOW , SQL, PYTHON/PYSPARKHands on exp in doing Production Support & willingness to work in Production SupportKey...
-
Helius Technologies | BAU Data Engineer
3 weeks ago
Hyderabad, India Helius Technologies Full timeHi,One of our clients is looking for BAU Data Engineer Consultant and would like to know your interest on the same.JOB DESCRIPTIONShould be a Lead with min 4-8 members team management.Mandatory Skills : AWS (S3,GLUE) , SNOWFLAKE , AIRFLOW , SQL, PYTHON/PYSPARKHands on exp in doing Production Support & willingness to work in Production SupportKey...
-
Helius Technologies | BAU Data Engineer
3 weeks ago
hyderabad, India Helius Technologies Full timeHi,One of our clients is looking for BAU Data Engineer Consultant and would like to know your interest on the same.JOB DESCRIPTIONShould be a Lead with min 4-8 members team management.Mandatory Skills : AWS (S3,GLUE) , SNOWFLAKE , AIRFLOW , SQL, PYTHON/PYSPARKHands on exp in doing Production Support & willingness to work in Production SupportKey...
-
Helius Technologies | BAU Data Engineer
3 weeks ago
hyderabad, India Helius Technologies Full timeHi,One of our clients is looking for BAU Data Engineer Consultant and would like to know your interest on the same.JOB DESCRIPTIONShould be a Lead with min 4-8 members team management.Mandatory Skills : AWS (S3,GLUE) , SNOWFLAKE , AIRFLOW , SQL, PYTHON/PYSPARKHands on exp in doing Production Support & willingness to work in Production SupportKey...
-
Helius Technologies | BAU Data Engineer
3 weeks ago
hyderabad, India Helius Technologies Full timeHi, One of our clients is looking for BAU Data Engineer Consultant and would like to know your interest on the same. JOB DESCRIPTION Should be a Lead with min 4-8 members team management. Mandatory Skills : AWS (S3,GLUE) , SNOWFLAKE , AIRFLOW , SQL, PYTHON/PYSPARK Hands on exp in doing Production Support & willingness to work in Production Support Key...
-
Glencore | Data Engineer
4 weeks ago
Hyderabad, India Glencore Full timeData EngineerDepartment: SurveillanceTechnologyChennaiThis role sits within the IT function and will be mainly responsible for driving the definition, alignment and execution of the global trade surveillance vision and strategy for Glencore, including production of a global roadmap for Glencore trade surveillance rollout, managing all impacts from new...
-
Data Designer
4 weeks ago
Hyderabad, Telangana, India NTT DATA Full time**Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT...
-
Data Unveil Quality Assurance Specialist
2 weeks ago
Hyderabad, Telangana, India Data Unveil Full timeAbout Data Unveil:We believe in delivering the best for our clients. We leverage the latest technology and tools to aggregate and analyze specialty healthcare data received from various partners. Our goal is to provide clear and hassle-free business insights to enhance our clients' vision and drive success.Job Title: Quality Assurance Engineer (ETL)Hire...
-
Data Science Engineer
3 weeks ago
Hyderabad, Telangana, India iHub-Data, IIIT Hyderabad Full timeiHub-Data, IIIT Hyderabad is seeking a highly skilled Data Science Engineer to join our team. We are looking for an expert in computer vision to design and develop innovative machine learning solutions.About the RoleThis position requires at least 5 years of experience in data science with expertise in computer vision. The ideal candidate should have...
-
Data Steward Engineer
4 days ago
Hyderabad, India Vision Data Analytics Full timePosition : Data Operations Steward. Experience : 6+ Years. Location : Hyderabad (WFO Hybrid). Full-time employee. Required Skills :- Proper Data, Warehousing, Salesforce expertise, steward. WHAT YOU'LL NEED :- Bachelor's degree in Information Technology, Data Management, or a related field.- 6+ years of experience in data management, governance, or...
-
Deep Learning Software Engineer
1 month ago
Hyderabad, Telangana, India iHub-Data, IIIT Hyderabad Full timeiHub-Data, IIIT Hyderabad is seeking a talented and experienced Machine Learning/Deep Learning Software Engineer to join our dynamic and innovative team.Job DescriptionWe are looking for a passionate engineer who will help build practical applications in using images and video.In this position, the person will be required to:Scale up proof-of-concept (POC)...
-
Tatras Data
4 weeks ago
Hyderabad, India Tatras Data Services Pvt Ltd Full timeLocation : Bangalore/Hyderabad (Hybrid - 3 days in office)Experience Required : 3+ relevant years of experienceEducational Qualification : B.Tech, B.Sc., or Software EngineeringKey Skills and Requirements :- Programming Expertise : Strong proficiency in Python programming for data analysis and automation tasks.- Database Skills : Advanced SQL skills are...
-
hyderabad, India iHub-Data, IIIT Hyderabad Full timeJob Title : Computer Vision EngineerPosition: OnsiteLocation: Inside the IIIT University Gachibowli HyderabadPrimary Skills:Computer Vision, Machine Learning, Artificial Intelligence, Python, Deep LearningDegree:B.Tech/B.E.Job Description:iHub-Data is seeking a talented and experienced Machine Learning/Deep Learning Software Engineer to join our dynamic and...
-
Hyderabad, India iHub-Data, IIIT Hyderabad Full timeJob Title : Computer Vision EngineerPosition: OnsiteLocation: Inside the IIIT University Gachibowli HyderabadPrimary Skills:Computer Vision, Machine Learning, Artificial Intelligence, Python, Deep LearningDegree:B.Tech/B.E.Job Description:iHub-Data is seeking a talented and experienced Machine Learning/Deep Learning Software Engineer to join our dynamic and...
-
Quality Assurance Engineer
4 weeks ago
Hyderabad, India Data Unveil Full timeAbout us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success. Position Title: QA...
-
hyderabad, India iHub-Data, IIIT Hyderabad Full timeJob Title : Computer Vision Engineer Position: Onsite Location: Inside the IIIT University Gachibowli Hyderabad Primary Skills: Computer Vision, Machine Learning, Artificial Intelligence, Python, Deep Learning Degree: B.Tech/B.E. Job Description: iHub-Data is seeking a talented and experienced Machine Learning/Deep Learning Software Engineer to join our...
-
hyderabad, India iHub-Data, IIIT Hyderabad Full timeJob Title : Computer Vision EngineerPosition: OnsiteLocation: Inside the IIIT University Gachibowli HyderabadPrimary Skills:Computer Vision, Machine Learning, Artificial Intelligence, Python, Deep LearningDegree:B.Tech/B.E.Job Description:iHub-Data is seeking a talented and experienced Machine Learning/Deep Learning Software Engineer to join our dynamic and...
-
hyderabad, India iHub-Data, IIIT Hyderabad Full timeJob Title : Computer Vision Engineer Position: Onsite Location: Inside the IIIT University Gachibowli Hyderabad Primary Skills: Computer Vision, Machine Learning, Artificial Intelligence, Python, Deep Learning Degree: B.Tech/B.E. Job Description: iHub-Data is seeking a talented and experienced Machine Learning/Deep Learning Software Engineer to join our...
-
Assoc. Dir. Ddit Isc Endpoint
7 months ago
Hyderabad, Telangana, India Novartis Full time393086BR **Assoc. Dir. DDIT ISC Endpoint & Data**: India **About the role** Location : #L1 Hybrid Your responsibilities include but not are limited to: - Champion significant projects and business initiatives, demonstrating creativity and ingenuity to meet the agreed standards - Collaborate with CSOC in support of Cybersecurity Threat Monitoring from...
