Azure databrick

5 days ago

Kottayam, India HARP Full time

Job Description: Minimum 8 to 11 years of hands-on experience with Databricks platform and Azure Data Factory. Expertise in building and optimizing ELT/ETL pipelines using Databricks and Azure Data Factory. Strong knowledge of Azure Data Factory for orchestration of data workflows and integration. Experience with Databricks Delta Lake implementation, cluster configuration, and performance tuning. Proficient in handling structured and semi-structured data using SQL, Py Spark, or similar technologies. Skilled in designing scalable data lake architectures leveraging Azure Data Factory and Databricks. Ability to migrate on-premise data sources to cloud platforms and automate pipelines using CI/CD practices. Familiarity with data governance, data lineage, and security best practices within Azure environments. Strong analytical skills to translate business requirements into technical specifications for data solutions. Good communication skills to collaborate with stakeholders and technical teams. Roles and Responsibilities: Lead the design, development, and deployment of data pipelines using Databricks and Azure Data Factory. Configure and optimize Databricks clusters and workspaces to ensure high performance and cost efficiency. Develop and maintain ELT workflows to process large volumes of data from diverse sources. Monitor and troubleshoot data pipeline issues to ensure data quality and timely delivery. Implement security controls and access management in Databricks and Azure Data Factory. Collaborate with business analysts and architects to understand requirements and provide technical solutions. Mentor junior team members on Databricks and Azure Data Factory best practices and tools. Participate in code reviews, design discussions, and documentation to maintain high standards. Estimate effort and contribute to project planning and delivery in agile environments. Ensure compliance with organizational policies and industry standards for data management.

  • Need minimum 6+ Years exp.

    2 days ago

    Kottayam, India E-Solutions Full time

    Job Role: Databricks Engineer with CDC (Change Data Capture) & Kafka exp.Location: Pan IndiaMinimum Experience: 6+ YearsType of Employment: PermanentMust Have Skills: Databricks or equivalent bigdata frameworks, CDC (change Data Capture), Kafka6+ years of experience designing and building data pipelines using-Apache Spark, Databricks or equivalent bigdata...

  • Data Engineer-Python

    3 weeks ago

    Kottayam, India People Prime Worldwide Full time

    About Client:Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate innovation....

  • Data Engineer-Python

    3 weeks ago

    Kottayam, India People Prime Worldwide Full time

    About Client:Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate innovation....

  • Data Engineer

    2 days ago

    Kottayam, India Vriba Solutions Full time

    Role: Data Engineering Remote Looking for 5-10 years of Exp• Design, develop & maintain ETL/ELT pipelines• Ingest & transform data from APIs, DBs, files, streams• Build real-time & batch processing solutions• Data validation, quality & cleansing• Translate business needs into data models• Ensure data security, access control & compliance•...

  • Data project manager

    22 hours ago

    Kottayam, India Delphi Consulting Middle East Full time

    Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values. At Delphi Consulting Pvt. Ltd. , we foster a thriving environment with a hybrid work model that lets you prioritize what matters most. Interviews and onboarding are conducted virtually, reflecting...

  • AI Delivery

    1 week ago

    Kottayam, India NeerInfo Solutions Full time

    Key Responsibilities: - Lead large delivery teams (100+ members) specializing in AI / Gen AI. - Oversee a P&L of USD 10M+ across North America, Europe, and APAC. - Utilize Microsoft stack technologies for innovative solutions. - Develop value propositions based on delivery excellence for customers. - Engage senior stakeholders internally and externally with...

  • Data engineer

    21 hours ago

    Kottayam, India Tata Consultancy Services Full time

    TCS has been a great pioneer in feeding the fire of young techies like you. We are global leaders in the technology arena and there's nothing that can stop us from growing together. TCS Hiring for skill " Digital: AWS Data Engineer". Role: AWS Data Engineer – Databricks Required Technical Skill Set: Data Lake architecture, AWS Services – S3, EMR,...

  • DevOps Engineer

    4 days ago

    Kottayam, India Accolade Full time

    About the CompanyThe multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront. We are building the industry's first AI-native Operations Centralization Platform, designed to streamline complex processes, unlock new efficiencies, and create better experiences for residents and operators alike. Our platform uses...