Data Engineer
3 weeks ago
Role : Databricks Senior DeveloperRequired Technical Skill Set : Databricks, Spark and Data Migration experienceExperience : 4 to 10 yearsLocation : KolkataJob Description : Desired Competencies (Technical/Behavioral Competency)Must-Have:-1. 8+ years with strong Databricks, Spark and Data Migration experience2. Should have experience of end-to-end migration from AWS Redshift or other RDS to Databricks Lakehouse Platform. Need to have knowledge in Cloud Data Engineering, ETL Modernization, Spark Optimization and SQL-to-PySpark migration.3. Key Responsibilities:-a) Migration Strategy and Execution: analyze the existing DWH/DB architecture, Design & Implement scalable data pipelines in Databricks, SQL Script conversion, etc.b) Development & Optimization: Build Delta Lake tables and Implement ACID-complaint data models, Manage metadata, schema evolution and lineage for migrated datasetsc) Collaboration & Governance: Work with Data Architect to define Target data models and migration approaches, Collaborate with DevOps teams to implement CI/CD pipelines, Data Governance teams on Security, lineage and cataloging; Mentor junior members in the teamd) Nice to have experience with Unity Catalog for governance and access control; Exposure to machine learning/AI pipelines, etc.
-
Data Engineer
4 weeks ago
Moradabad, India LanceSoft, Inc. Full timePay Rate: $11.00/hr to $12.00/hrLocation: 100% RemoteThis team is looking to hire a motivated Sr. Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data platform to solve various data-driven use cases across the organization. This marketing platform will host various data products...
-
Data Engineer
4 weeks ago
Moradabad, India LanceSoft, Inc. Full timePay Rate: $11.00/hr to $12.00/hrLocation: 100% RemoteThis team is looking to hire a motivated Sr. Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data platform to solve various data-driven use cases across the organization. This marketing platform will host various data products...
-
Cloud Data Engineer
4 days ago
moradabad, India beBeeData Full timeSeeking a seasoned cloud engineer with expertise in Databricks to spearhead data engineering, analytics, and machine learning initiatives.The ideal candidate will possess extensive experience in designing, deploying, and managing scalable and secure cloud infrastructure on AWS, as well as in-depth knowledge of the Databricks platform.Key...
-
Data Engine Architect
1 week ago
moradabad, India beBeeSearch Full timeSearch Engineer Job DescriptionKey Responsibilities:We are seeking a skilled Search Engineer to design and implement search solutions using OpenSearch/Elasticsearch. The ideal candidate will have expertise in custom analysers, tokenisers, and scoring algorithms.Index & Template Management:The successful candidate will be responsible for creating and...
-
Data Engineer Opportunity
1 week ago
moradabad, India beBeeTechnical Full timeCustomer Success SpecialistThis role is for a data engineer who excels in customer-facing work and resolving complex technical issues. The ideal candidate will have strong communication skills, be comfortable working with diverse teams, and have experience with CDP platforms.Key Responsibilities:Implement and support AI solutions for customers across the...
-
Chief Data Engineering Officer
1 week ago
moradabad, India beBeeDataEngineer Full timeKey Data Engineer RoleWe are seeking an experienced data engineer to drive business insights and operational efficiency through scalable data pipelines.ResponsibilitiesDesign, develop, and maintain ETL/ELT pipelines using PySpark and AWS Glue, ensuring scalability and high data quality.Build and optimize data models in Snowflake for reporting, analytics, and...
-
Azure Data Engineering Professional
2 weeks ago
moradabad, India beBeeDataMigration Full timeAzure Data Engineer PositionWe are seeking a skilled data engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem.The ideal candidate will have a strong foundation in data integration, transformation, and migration, along with a passion for working on complex data migration projects.Lead large-scale SQL...
-
Senior Cloud Data Engineer
2 weeks ago
moradabad, India beBeeDataEngineering Full timeCloud Data Engineering OpportunityWe are seeking a seasoned professional to join our team as a cloud data engineer.The ideal candidate will have extensive experience with cloud-based data engineering, with a strong background in Google Cloud Platform (GCP).Key Skills:Cloud Data EngineeringStorage SolutionsBig Data ProcessingCloud-Based AnalyticsPython...
-
Chief Data Engineer
2 weeks ago
moradabad, India beBeeDataEngineer Full timeMigrating data sources and reports is a crucial aspect of this role. The successful candidate will be responsible for repointing and validating existing reports, as well as designing new tables and queries.Migration to cloud-based platforms such as BigQuery requires expertise in data warehousing and ETL processes.Collaboration with cross-functional teams is...
-
GCP Data Engineer
2 weeks ago
Moradabad, India Tata Consultancy Services Full timeDear ProfessionalsGreetings from TCS!!!Job Title : GCP Data EngineerExperience : 6- 8 YearsLocation : Pune/Hyderabad/bangalore/ chennai/ kolkataSkills: GCP, Big Query, Dataflow, Data Proc, Cloud SQL, Cloud Spanner, Pub/Sub, ETL, Apache airflow, Python, Pandas and NumphyJD: Google Data Engineer (Overall 5+ Years with 3 years relevant hands-on experience)...