
Lead Consultant Data Engineer, Azure+Python
4 weeks ago
Inviting applications for the role of Lead Consultant-Data Engineer, Azure+Python
Responsibilities
. Design and deploy scalable, highly available, and fault-tolerant AWS data processes using AWS data services (Glue, Lambda, Step, Redshift)
. Monitor and optimize the performance of cloud resources to ensure efficient utilization and cost-effectiveness.
. Implement and maintain security measures to protect data and systems within the AWS environment, including IAM policies, security groups, and encryption mechanisms.
. Migrate the application data from legacy databases to Cloud based solutions (Redshift, DynamoDB, etc) for high availability with low cost
. Develop application programs using Big Data technologies like Apache Hadoop, Apache Spark, etc with appropriate cloud-based services like Amazon AWS, etc.
. Build data pipelines by building ETL processes (Extract-Transform-Load)
. Implement backup, disaster recovery, and business continuity strategies for cloud-based applications and data.
. Responsible for analysing business and functional requirements which involves a review of existing system configurations and operating methodologies as well as understanding evolving business needs
. Analyse requirements/User stories at the business meetings and strategize the impact of requirements on different platforms/applications, convert the business requirements into technical requirements
. Participating in design reviews to provide input on functional requirements, product designs, schedules and/or potential problems
. Understand current application infrastructure and suggest Cloud based solutions which reduces operational cost, requires minimal maintenance but provides high availability with improved security
. Perform unit testing on the modified software to ensure that the new functionality is working as expected while existing functionalities continue to work in the same way
. Coordinate with release management, other supporting teams to deploy changes in production environment
Qualifications we seek in you
Minimum Qualifications
. Experience in designing, implementing data pipelines, build data applications, data migration on AWS
. Strong experience of implementing data lake using AWS services like Glue, Lambda, Step, Redshift
. Experience of Databricks will be added advantage
. Strong experience in Python and SQL
. Strong understanding of security principles and best practices for cloud-based environments.
. Experience with monitoring tools and implementing proactive measures to ensure system availability and performance.
. Excellent problem-solving skills and ability to troubleshoot complex issues in a distributed, cloud-based environment.
. Strong communication and collaboration skills to work effectively with cross-functional teams.
Preferred Qualifications/ Skills
. Master's Degree-Computer Science, Electronics, Electrical.
. AWS Data Engineering & Cloud certifications, Databricks certifications
. Experience of working with Oracle ERP
. Experience with multiple data integration technologies and cloud platforms
. Knowledge of Change & Incident Management process
-
-
-
-
-
-
Azure Data Engineer
3 weeks ago
Kolkata, West Bengal, India GC Technologies Pvt Ltd Full timeData EngineerLocation: Pune -WFONP :15daysExperience : 5+yrsBudget: Max 12 LPAPayroll: Prontoex Consulting Services Pvt LtdEnd Clinet: Comsense Technologies Private Limited , 7th Floor Property bearing No.465/E1, Park Plaza, IndiQube, CTS-1085, Ganeshkhind Rd, Shivajinagar, Pune, Maharashtra 411005JD :Minimum QualificationBachelor's degree in Computer...
-
Azure Data Engineer
3 days ago
Kolkata, West Bengal, India Sys Edge Micro Informatics Full time ₹ 6,00,000 - ₹ 12,00,000 per yearRole & responsibilitiesAssist in data collection, cleansing, and preparation from various sources.Support basic data modeling and documentation efforts.Develop and maintain simple data pipelines using tools like Azure Data Factory (ADF).Write and optimize queries using SQL.Use Python or PySpark scripts to perform data transformations.Perform data validation...
-
Kolkata, West Bengal, India GENPACT Full timeGenpact NYSE G is a global professional services and solutions firm delivering outcomes that shape the future Our 125 000 people across 30 countries are driven by our innate curiosity entrepreneurial agility and desire to create lasting value for clients Powered by our purpose - the relentless pursuit of a world that works better for people - we...
-
Azure Data Engineer Lead Professional
2 weeks ago
Kolkata, West Bengal, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000Job ProfileThe ideal candidate for this role is a seasoned data engineer with extensive experience in designing, building and maintaining large-scale data engineering projects on Azure.Key Responsibilities:Create and implement scalable data pipelines using Azure Data Factory, Databricks and PySpark technologies.Collaborate closely with cross-functional teams...
-
Lead Consultant Python Developer
3 weeks ago
Kolkata, West Bengal, India Genpact Full timeJob DescriptionReady to build the future with AIAt Genpact, we don't just keep up with technology-we set the pace. AI and digital innovation are redefining industries, and we're leading the charge. Genpact's AI Gigafactory, our industry-first accelerator, is an example of how we're scaling advanced technology solutions to help global enterprises work...
-
Leading Data Engineer
2 weeks ago
Kolkata, West Bengal, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Senior Data Engineering ExpertThe primary objective of this senior-level position is to design, build, and maintain high-quality data pipelines and validation processes. In this capacity, the successful candidate will have an extensive understanding of scalable data quality management systems.Key Responsibilities:Develop and implement robust data quality...
-
Lead Data Architect
2 weeks ago
Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job TitleWe are seeking an experienced Data Engineer to play a critical role in designing, developing and managing data pipelines and transformation frameworks that enable analytics, reporting and business intelligence capabilities across the enterprise.The ideal candidate will have hands-on experience in Microsoft Azure data ecosystem and possess strong...
-
Senior AI Researcher
2 weeks ago
Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000About our Data Engineering Opportunity:We are seeking a highly skilled Azure Data Engineer to lead applied research in Generative AI, including LLMs, Vision-Language Models, Multimodal AI, and Prompt Engineering.Your Key Responsibilities:Conduct innovative research in Generative AI, including developing and evaluating AI models using tools like PyTorch,...
-
Kolkata, West Bengal, India Genpact Full timeJob DescriptionInviting applications for the role of Assistant Vice President, Azure Data & AI Delivery LeaderWe are seeking a dynamic and visionary Azure Data & AI Delivery Leader to spearhead the execution of large-scale, enterprise-grade data transformation and AI initiatives on the Microsoft Azure platform. This leadership role is pivotal in driving...
-
Azure Devops Engineer
2 weeks ago
Kolkata, West Bengal, India Infocus Technologies Full time ₹ 9,00,000 - ₹ 12,00,000 per yearWe are experts in Business consulting in SAP domain catering to development of entirely new modules, sub-systems or entire applications migration, upgrade to the enterprise's requirement to move to new releases or new technology. Our resources' profound knowledge in key subject areas, based on experience and practical hands-on knowledge firmly sets us apart...