
Data Pipeline Expert
6 days ago
Senior Databricks Engineer Opportunity
We are seeking a highly skilled Senior Databricks Data Engineer to join our dynamic data engineering team. The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code.
Key Responsibilities:
- Design, develop, and maintain scalable and high-performance data pipelines using Databricks and PySpark.
- Implement and manage data solutions on AWS, including services like S3, Glue, Lambda, EMR, and Redshift.
- Use CI/CD tools for automated deployment and testing of data workflows.
- Develop infrastructure as code using Terraform to provision and manage cloud resources.
- Collaborate with data scientists, analysts, and other engineering teams to support end-to-end data solutions.
- Monitor, troubleshoot, and optimize performance of data pipelines and cloud infrastructure.
Required Skills and Qualifications:
- Strong hands-on experience with Databricks (Mandatory)
- Solid experience with AWS cloud services (Mandatory)
- Proficiency in PySpark and distributed data processing
- Experience in CI/CD implementation for data workflows
- Hands-on with Terraform for infrastructure management
-
Data Pipeline Architect
1 week ago
Hubli, Karnataka, India beBeeAzure Full time ₹ 15,00,000 - ₹ 25,00,000Senior Azure Databricks EngineerWe are seeking an expert Senior Azure Databricks Engineer to spearhead the design, development, and optimization of data ingestion pipelines for integrating multiple sources into Databricks.Key Responsibilities:Design and develop scalable data ingestion pipelines for integrating multiple sources into Databricks.Implement and...
-
Expert Data Pipeline Specialist
5 days ago
Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Data Engineer Job OpportunityThreatXIntel is a cyber security company focused on protecting businesses and organizations from cyber threats.We offer customized cloud security, web and mobile security testing, and DevSecOps services to meet the specific needs of our clients.A key requirement for this role is designing, developing, and optimizing data...
-
Expert Data Pipeline Designer
5 days ago
Hubli, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Freelance Data Engineer PositionWe are seeking a seasoned Freelance Data Engineer with exceptional skills in designing, building, and optimizing large-scale data pipelines. As part of our team, you will collaborate closely with internal teams and clients to deliver robust, scalable, and high-performance data solutions.Key Responsibilities:Develop ETL/ELT...
-
Data Pipeline Specialist
6 days ago
Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000As a Data Engineer, you will play a pivotal role in crafting and implementing scalable data pipelines to support our growing data needs. Your expertise in Bigdata, Pyspark, Python, Hadoop/HDFS, Spark, and GCP/any cloud will enable you to collaborate with analytics and business teams to refine data models and foster data-driven decision making across the...
-
Data Pipelines Engineer
7 days ago
Hubli, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 18,00,000Big Data SpecialistWe are seeking a highly skilled professional to design, develop, and maintain robust ETL/ELT data pipelines for our organization.Key Responsibilities:Design and develop efficient ETL/ELT data pipelines using AWS services such as Lambda, DMS, and Glue.Develop and optimize Snowflake stored procedures to implement complex business logic and...
-
Data Pipeline Specialist
6 days ago
Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,50,00,000About the RoleWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a key role in designing and implementing scalable data pipelines using Azure Databricks, PySpark, and Delta Lake.ResponsibilitiesDesign and implement ETL/ELT pipelines using Azure Databricks and PySpark.Develop high-quality database programming...
-
Key Data Engineering Expert
3 minutes ago
Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000Our organization is seeking a highly skilled and experienced Data Engineering expert to assume key responsibilities.The ideal candidate will have:4+ years of hands-on experience with Big Data technologies – including Spark, Hadoop, and Hive;Strong analytical and problem-solving skills, with the ability to think critically;Excellent communication and...
-
Data Pipeline Specialist
1 day ago
Hubli, Karnataka, India beBeeBlockchain Full time ₹ 1,20,00,000 - ₹ 2,50,00,000Backend Data EngineerA key role awaits in our organization for a highly skilled Backend Data Engineer.This is an exciting opportunity to play a pivotal part in transforming raw on-chain data into actionable insights.Develop event decoders for major DeFi protocols, such as Uniswap and Curve.Build and maintain data extractors that convert on-chain events into...
-
Highly Skilled Data Pipeline Architect
1 week ago
Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Title: Senior Data EngineerAbout the RoleWe are seeking a highly skilled and experienced data engineer to play a critical role in designing, developing, and maintaining complex data pipelines.Key Responsibilities:Data Pipeline Development and MaintenanceUtilize various tools and technologies to design and implement efficient ETL pipelines.Data...
-
Senior Data Pipeline Developer
5 days ago
Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 35,00,000 - ₹ 45,00,000We're seeking a seasoned professional to lead the development of complex data pipelines.**Key Responsibilities:**- Design and deploy sophisticated ETL processes using Talend Open Studio.- Utilize BigQuery for advanced SQL, partitioning, clustering, federated queries.- Leverage Python for ETL scripting, automation, and integration with cloud data pipelines.-...