
Module Lead Data Engineer
2 weeks ago
Job Description
- 6-8 years of good hands on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive
- Good hands on experience of python and Bash Scripts
- Good understanding of SQL and data warehouse concepts
- Strong analytical, problem-solving, data analysis and research skills
- Demonstrable ability to think outside of the box and not be dependent on readily available tools
- Excellent communication, presentation and interpersonal skills are a must
- Hands-on experience with using Cloud Platform provided Big Data technologies (i.e. IAM, Glue, EMR, RedShift, S3, Kinesis)
- Orchestration with Airflow and Any job scheduler experience
- Experience in migrating workload from on-premise to cloud and cloud to cloud migrations
Roles & Responsibilities
- Develop efficient ETL pipelines as per business requirements, following the development standards and best practices.
- Perform integration testing of different created pipeline in AWS env.
- Provide estimates for development, testing & deployments on different env.
- Participate in code peer reviews to ensure our applications comply with best practices.
- Create cost effective AWS pipeline with required AWS services i.e S3,IAM, Glue, EMR, Redshift etc.
-
Senior AI and Data Engineer
1 day ago
Surat, Gujarat, India beBeeQuality Full time ₹ 17,50,000 - ₹ 21,25,000Job Description:Narwal is a global delivery company that excels in AI, Data, and Quality Engineering solutions. Our team consistently surpasses expectations, achieving remarkable growth rates year after year.Our mission is to be an expert in AI, Data, Cloud, and Quality Engineering transformations. We are bold in our thinking and authentic in our...
-
SAP Data Migration Project Lead
1 day ago
Surat, Gujarat, India beBeeDataMigration Full time ₹ 90,00,000 - ₹ 1,20,00,000Leading SAP data migration expert sought to spearhead end-to-end projects.Job DescriptionOur organization is looking for a highly skilled and experienced SAP data migration consultant to play a crucial role in planning, executing, and managing data migration activities for SAP projects. The ideal candidate will possess strong expertise in SAP data management...
-
Chief Data Engineer
1 day ago
Surat, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job OpportunityWe are seeking an experienced Data Architect to lead our team's efforts in designing and implementing scalable, secure, and efficient data solutions.The successful candidate will be responsible for architecting data lakes, developing data pipelines, and implementing data warehousing solutions using Databricks. They will collaborate with data...
-
Lead Implementation Engineer
4 weeks ago
Surat, Gujarat, India Motadata Full timePosition Title: Lead Implementation EngineerExperience: 7+ YearsLocation: Ahmedabad (WFO) About MotadataMotadata is a renowned IT monitoring and management software company that has been transforming how businesses manage their ITOps since its inception. Our vision is to revolutionize the way organizations extract valuable insights from their IT...
-
Lead Big Data Specialist
1 day ago
Surat, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000We seek a Senior Data Engineer to join our team.Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.Architect and implement data warehouses, data lakes, and other storage solutions that support analytics and reporting needs.Optimize data architectures and...
-
Cloud Engineer with Scalable Data Solutions
16 hours ago
Surat, Gujarat, India beBeeDataArchitect Full time US$ 10,00,000 - US$ 15,00,000Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to lead the design, development, and optimization of our data engineering architecture.The ideal candidate will have a deep understanding of cloud-native data engineering on Microsoft Azure, and experience with AWS and GCP.They will be responsible for building scalable data pipelines,...
-
Azure data Engineer Trainer(Online)
3 weeks ago
Surat, Gujarat, India Coding Superstar Full timeJob Title: Azure Data Engineering Trainer (Online) Location: Remote (India) Type: Part-time / Freelance / Weekend availability preferred Company: Coding SuperstarAbout Us: Coding Superstar is a leading edtech company offering job-oriented IT training focused on real-world projects and high-conversion placement support. We are looking for passionate trainers...
-
Lead Data Analyst
4 days ago
Surat, Gujarat, India beBeeData Full time ₹ 1,04,80,000 - ₹ 2,68,00,000Job DescriptionWe are seeking a highly skilled data analyst to join our team. The ideal candidate will have a deep understanding of statistical methodologies, mathematical optimization, and machine learning.Responsibilities include collaborating with product design and engineering teams, collecting and analyzing datasets, developing statistical models, and...
-
Senior Data Engineer
1 day ago
Surat, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Transforming Data into InsightsAbout This RoleWe are seeking an experienced data engineer to drive the development and maintenance of efficient data pipelines. The ideal candidate will possess a strong background in extract, transform, and load (ETL) processes, data engineering, and experience working with cloud-based data platforms.Data Pipeline...
-
Senior Data Engineer
4 days ago
Surat, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 19,20,000We are modernizing our demand forecasting capabilities through a cutting-edge AI platform. We are seeking a highly skilled Data Scientist to design and operationalize advanced forecasting solutions at scale.Job Responsibilities:Create, build, and deploy production-grade prediction modelsDevelop end-to-end machine learning pipelines for data ingestion,...