
Scalable Data Solutions Specialist
5 days ago
This is a challenging and rewarding role that requires expertise in designing, implementing, and maintaining large-scale data pipelines using Azure Databricks (PySpark/Scala).
The ideal candidate will have strong experience with Apache Spark, proficiency in developing Azure Function Apps using C#, Python, or JavaScript, and solid understanding of Azure Data Lake, Event Hubs, Blob Storage, and Key Vault.
In addition to technical skills, the successful candidate will have strong problem-solving skills, ability to work in an agile environment, and excellent communication skills.
Key Responsibilities:
- Design and implement scalable data pipelines using Azure Databricks (PySpark/Scala)
- Develop and deploy Azure Function Apps for event-driven data processing and automation
- Integrate Databricks with other Azure services like Data Lake Storage, Synapse, Event Hubs, Key Vault, etc.
- Optimize Spark jobs for performance and cost-efficiency
- Implement CI/CD pipelines using Azure DevOps for Databricks notebooks and Function Apps
- Monitor and troubleshoot production workloads, ensuring high availability and reliability
Required Skills & Qualifications:
- Strong experience with Azure Databricks and Apache Spark (PySpark or Scala)
- Proficiency in developing Azure Function Apps using C#, Python, or JavaScript
- Solid understanding of Azure Data Lake, Event Hubs, Blob Storage, and Key Vault
- Experience with CI/CD pipelines, Git, and Infrastructure as Code (ARM/Bicep/Terraform)
- Familiarity with data modeling, ETL/ELT processes, and data governance
Benefits:
- Opportunity to work on challenging projects and collaborate with experienced professionals
- Professional development and growth opportunities
- Competitive compensation and benefits package
Others:
This is a contract-to-hire position, and the ideal candidate should have 4-12 years of experience in the field. The notice period is immediate, and the location is Tiruppur, IN.
-
Scalable IoT Solutions Specialist
2 days ago
Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 12,00,000 - ₹ 18,00,000Job Title: Data SpecialistJob Summary:We are seeking a highly skilled data engineer to design and implement scalable IoT data solutions. The ideal candidate will have extensive experience in AWS services, Python programming, and data transformation.The successful applicant will be responsible for designing, developing, and deploying efficient data pipelines...
-
Data Engineer for Scalable Solutions
20 hours ago
Tiruppur, Tamil Nadu, India beBeeDataEngineering Full time ₹ 14,00,000As a seasoned professional, you have the opportunity to join a dynamic team as a Data Engineer for scalable solutions.Job DescriptionWe are seeking a skilled individual to design and develop robust data pipelines using AWS services such as S3, Lambda, and Glue.Collaborate with cross-functional teams to identify business requirements and implement data-driven...
-
Data Solutions Specialist
1 week ago
Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000Job Title: Data Solutions SpecialistBecome an integral part of our team as a data professional, where you will be responsible for designing and implementing data pipelines using Azure Data Factory.Key Responsibilities:Design, implement, and manage scalable data processing solutions within Azure Synapse Analytics.Provide actionable insights through data...
-
Building Scalable Data Infrastructure
2 days ago
Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000Data Architect SpecialistWe seek a seasoned professional to design and implement robust data pipelines, ensuring seamless data accessibility for analytics and operations.The ideal candidate will possess expertise in Python programming, Azure Data Factory, and Databricks for data integration and analytics. Experience with data modeling, ETL, and database...
-
Scalable Data Architect
2 days ago
Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000A fast, easy, and collaborative analytics platform is required for this role.Job OverviewWe seek an experienced data engineer to develop scalable data architectures.The ideal candidate will have a strong background in data engineering and expertise in designing large-scale data pipelines.Key Responsibilities:Design and develop large-scale data pipelines...
-
A Scalable Data Engineer
4 days ago
Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000Big Data Engineer OpportunityWe are seeking a seasoned Big Data Engineer II to join our team. This is an exciting opportunity for a talented professional to play a key role in designing, executing, and managing large and complex distributed data systems.Main Responsibilities:Design and manage large-scale distributed data systems to meet business needsMonitor...
-
Crafting Scalable Data Pipelines Specialist
18 hours ago
Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000As a senior data engineer, you will play a pivotal role in crafting and implementing scalable data pipelines and transformation frameworks to drive analytics, reporting, and business intelligence across the enterprise.You will collaborate closely with data architects, platform engineers, and DevOps teams to develop efficient data engineering solutions using...
-
Expert Enterprise Data Solutions Designer
21 hours ago
Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 1,55,00,000 - ₹ 2,45,00,000Job Title:Enterprise Data Architecture Specialist About the Role:This role involves architecting end-to-end enterprise-grade data solutions that align with business goals and technical strategy.Key Responsibilities:Design scalable, secure, and aligned data architecturesDefine integration patterns and governance frameworksCollaborate with cross-functional...
-
Data Generation Specialist
5 days ago
Tiruppur, Tamil Nadu, India beBeeDataGeneration Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Data Generation SpecialistWe are seeking a highly skilled Data Generation Specialist to join our team.A Data Generation Specialist is responsible for designing, building and deploying generative AI solutions using LLMs such as OpenAI, Anthropic, Mistral, or open-source models (e.g., LLaMA, Falcon).Key Responsibilities:Fine-tune and customize...
-
Salesforce Data Cloud Specialist
2 days ago
Tiruppur, Tamil Nadu, India beBeeDataCloud Full time ₹ 90,00,000 - ₹ 2,01,00,000Job Title: Salesforce Data Cloud SpecialistWe are seeking an experienced professional with a proven track record in designing and implementing unified customer data solutions using Salesforce Data Cloud.Key Responsibilities:Design, configure, and implement scalable Salesforce Data Cloud solutions including data streams for ingestion, data model objects,...