
Azure Databricks Engineer with Injection experience
4 weeks ago
Title: Azure Databricks Engineer with Injection experience
Location: Remote (India)
Duration: 6 Month, (if the candidate is good with work, it can be extended to 1+ year )
Time: 10.00 AM- 7.00 PM IST
Need good comm skills – they will be coordinating with Americans on daily bases
for clarity : We are seeking an Ingestion Engineer with expertise in CI/CD and Kubernetes to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks. The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.
Key Responsibilities:
Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.
Implement and maintain CI/CD pipelines for data workflows.
Deploy and manage containerized applications using Kubernetes.
Ensure data integrity, security, and compliance throughout the ingestion process.
Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies.
Troubleshoot and optimize ingestion pipelines for performance and scalability.
Required Skills & Qualifications:
Proven experience in data ingestion and pipeline development.
Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.).
Strong knowledge of Kubernetes and container orchestration.
Experience with Databricks, Spark, and data lake architectures.
Proficiency in Python, Scala, or SQL for data processing.
Familiarity with cloud platforms such as AWS, Azure, or GCP.
Strong problem-solving and analytical skills.
Preferred Qualifications:
Experience with Infrastructure as Code (Terraform, Helm, etc.).
Background in streaming data ingestion (Kafka, Kinesis, etc.).
Knowledge of data governance and security best practices.
-
Azure Data Engineer
3 weeks ago
Palakkad, Kerala, India Texplorers Inc Full timeWe are seeking a skilled Data Engineer with proficient knowledge in Spark and SQLto join our dynamic team. The ideal candidate will be responsible for designing,implementing, and optimizing data pipelines on our Data platform. You will workclosely with data architects, and other stakeholders to ensure data accessibility,reliability, and performance.Key...
-
Associate Data Engineer
2 days ago
Palakkad, Kerala, India Leuwint technologies Full time ₹ 80,000 - ₹ 1,50,000 per yearJob descriptionWe are seeking an experienced Associate Data Engineer with strong expertise in AWS, Databricks, Informatica IDMC, and Tableau to design, build, and optimize scalable data solutions.Responsibilities & Qualifications:5+ years of experience in data engineering with expertise in AWS, Databricks, and Informatica IDMC.Design and implement scalable...
-
Internship in AI Engineering
4 weeks ago
Palakkad, Kerala, India Smart Tech LLC Full timeCompany DescriptionAt Smart Tech, we develop AI-driven solutions to tackle the world's most pressing data and AI challenges. We invite the brightest minds to collaborate and build real-world solutions aimed at improving the lives of millions and creating a better, more sustainable world.Role DescriptionThis is a remote role for an AI Engineering Intern. The...
-
Data Engineer
4 weeks ago
Palakkad, Kerala, India Infilon Technologies Pvt ltd Full timeInfilon Technologies is hiring an experienced Data Engineer (Immediate Joiner) for our US-based client, CalcuQuote - www.calcuquote.com. You'll play a key role in building and optimizing data pipelines, ensuring data is clean, secure, and accessible for analytics and operations. This role offers the chance to work closely with talented teams, solve...
-
AWS Data Engineer
3 weeks ago
Palakkad, Kerala, India Reveille Technologies,Inc Full timeHiring: Data Engineer - FTE Location: Coimbatore Experience: 3–5 Years | Type: Full-Time (FTE) Budget: Up to ₹14 LPA Notice Period: Immediate Joiners Only Mandatory Skills:AWSPythonPySparkDatabricks Interested? DM or share your resume : rajesh@reveilletechnologies.com ./.
-
Security Engineer
2 weeks ago
Palakkad, Kerala, India Wattlecorp Cybersecurity Labs Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout the Role:We are seeking an experienced Security Engineer with a strong focus on network and infrastructure security, VAPT, and compliance. The ideal candidate will have hands-on experience leading vulnerability management programs, conducting penetration tests, and implementing security best practices across hybrid environments. This role requires a...
-
Engineering Manager
3 weeks ago
Palakkad, Kerala, India Apeiro Full timeAperio OverviewEnabling governments to transform healthcare and ensuring no one is left behind in receiving high quality healthcare services. Apeiro is bringing healthcare into the digital age with state-of-the-art platforms, while creating an integrated, interoperable ecosystem for all healthcare stakeholders.Position OverviewEngineering Manager who...
-
BI Analyst
3 days ago
Palakkad, Kerala, India Leuwint technologies Full time $ 90,000 - $ 1,20,000 per yearJob descriptionMaintain and enhance IT systems, drawing on 5-6 years of overall development, implementation, and maintenance experience.Deliver data warehousing, BI, and analytics solutions with a minimum of 3-4 years of hands-on expertise.Lead implementation efforts across 3-4 full project cycles, contributing from design through deployment.Apply 1-2 years...
-
Data & AI Architect
4 weeks ago
Palakkad, Kerala, India QBurst Full timeDescription:We are seeking an experienced Architect to drive our data and AI streams. The ideal candidates are not just technical experts but also strategic thinkers who can act as independent consultants, guiding projects from concept to production. They should have a proven track record of designing, developing, and deploying robust, scalable, and...
-
Back End Developer
3 weeks ago
Palakkad, Kerala, India Velodata Global Pvt Ltd Full timeJob DescriptionDesignation: Senior Backend Data & Integration Engineer (Python/TypeScript, Azure, Integrations)Experience: 4 -8 YearsLocation: CochinJob SummaryBuild data pipelines (crawling/parsing, deduplication/delta, embeddings) and connect external systems and interfaces.Key Responsibilities:• Development of crawling/fetch pipelines (API-first;...