Azure Databricks + Pyspark

3 days ago

Bhubaneswar Orissa, India Cognizant Full time

**Job Summary**

**Responsibilities**
- Analyze complex data sets to identify trends and patterns that can inform business decisions.
- Develop and maintain data pipelines using Azure Data Factory to ensure seamless data integration.
- Utilize PySpark and Python to perform data transformations and analytics.
- Implement and manage workflows using BMC Control-M WA to ensure timely data processing.
- Collaborate with cross-functional teams to understand data requirements and deliver actionable insights.
- Create and maintain data models in Azure Databricks to support advanced analytics.
- Ensure data quality and integrity by performing regular audits and validations.
- Design and implement ETL processes to extract transform and load data into Azure Data Lake Store.
- Provide technical support and troubleshooting for data-related issues.
- Develop and maintain documentation for data processes and workflows.
- Monitor and optimize data pipelines for performance and efficiency.
- Stay updated with the latest industry trends and technologies to continuously improve data analytics capabilities.
- Communicate findings and insights to stakeholders through reports and presentations.

**Qualifications**
- Possess a Bachelors degree in Computer Science Information Technology or a related field.
- Demonstrate proficiency in BMC Control-M WA PySpark and Python.
- Have hands-on experience with Azure Databricks Azure Data Lake Store and Azure Data Factory ETL.
- Show strong analytical and problem-solving skills.
- Exhibit excellent communication and collaboration abilities.
- Display a proactive and self-motivated attitude.
- Have a solid understanding of data modeling and data warehousing concepts.
- Be familiar with data governance and data quality best practices.
- Show experience in developing and maintaining data pipelines.
- Demonstrate the ability to work in a hybrid work model.
- Have a minimum of 4 years and a maximum of 6 years of relevant experience.
- Be able to work effectively during the day shift.
- Show no requirement for travel.

**Certifications Required**
- Certified Data Management Professional (CDMP) Microsoft Certified: Azure Data Engineer Associate

  • Databricks + Pyspark

    3 days ago

    Bhubaneswar, Orissa, India Cognizant Technology Solutions Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 6 to 9 years of experience to join our dynamic team. The ideal candidate will have expertise in Delta Live Pipelines Python Databricks SQL Databricks Workflows and PySpark. This hybrid role involves working on cutting-edge projects that drive innovation and efficiency. The position is based on a...

  • Azure data Engineer

    4 weeks ago

    Bhubaneswar, India Tata Consultancy Services Full time

    Role: Azure data Engineer Experience: 4 Location: Bhubaneswar Must-Have 4+ years of hands-on experience in development. Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory, Synapse Strong knowledge Incident, problem, Change management, service management, service request. Must have hands on experience code versioning...

  • Data Engineer Azure Databricks, Python

    2 weeks ago

    Bhubaneswar, India Tata Consultancy Services Limited Full time

    Job Description Role- Data Engineer Azure Databricks, Python Job Description - Build the solution for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure data ingestion and transformation components. Following technology skills are required - Advanced working SQL knowledge and experience working with...

  • MLOPS Engineer

    1 day ago

    Bhubaneswar, Kolkata, India Cognizant Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: MLOPS EngineerLocation: Kolkata & Bhubaneswar / In-Person Interview (F2F)FulltimeKey words -SkillsetAWS SageMaker, Azure ML Studio, GCP Vertex AIPySpark, Azure DatabricksMLFlow, KubeFlow, AirFlow, Github Actions, AWS CodePipelineKubernetes, AKS, Terraform, Fast APIResponsibilities:Model Deployment, Model Monitoring, Model RetrainingDeployment pipeline,...

  • Data Engineer

    2 weeks ago

    Bhubaneswar, Indore, Pune, India Pineq Technology Labs Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Key Responsibilities:Design and implement data pipelines and ETL processes for scalable data management.Ensure data quality, governance, and pipeline performance optimization.Collaborate with teams to understand business requirements and deliver effective solutions.Troubleshoot and resolve data-related issues across systems.Mentor junior engineers and...

  • Data Platform Manager

    5 days ago

    Airport, Bhubaneswar, Orissa, India Hong Kong Aircraft Engineering Company Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The HAECO Group is an independent global provider of high-quality MRO services. We offer a broad range of aviation products and services that enable our customers to operate their aircraft, engines and components safely and efficiently. Headquartered in Hong Kong since 1950, our global reach has extended as we have grown. We now have operations throughout...

  • Data Scientist

    2 weeks ago

    Bhubaneswar, India LTIMindtree Full time

    Mandatory Skills - Gen-AI, Data Science, Python, RAG and Cloud (AWS/Azure). Secondary - (Any) - Machine Learning, Deep Learning, ChatGPT, Langchain, Prompt, vector stores, RAG, llama, Computer vision, Deep learning, Machine learning, OCR, Transformer, regression, forecasting, classification, hyper parameter tunning, MLOps, Inference, Model training, Model...

  • Data Scientist

    2 weeks ago

    bhubaneswar, India LTIMindtree Full time

    Mandatory Skills - Gen-AI, Data Science, Python, RAG and Cloud (AWS/Azure). Secondary - (Any) - Machine Learning, Deep Learning, ChatGPT, Langchain, Prompt, vector stores, RAG, llama, Computer vision, Deep learning, Machine learning, OCR, Transformer, regression, forecasting, classification, hyper parameter tunning, MLOps, Inference, Model training, Model...

  • AWS Data Engineer

    1 week ago

    Bengaluru, Bhubaneswar, Hyderabad, India Tata Consultancy Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    TCS Hiring for skill "AWS Data Engineer".Role: AWS Data Engineer (Developer)Required Technical Skill Set: AWS Data Engineers with Python Programming skills, should know Pyspark and SQL having clinical background is recommended but not necessary. (Note: GCP or Azure, or other cloud skills are not acceptable. AWS & Python are Must)Experience: 5+ YearsWork...

  • AIML Data Scientist- Kolkata

    1 day ago

    Bhubaneswar, Kolkata, India Cognizant Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: AI/ML - Deep Learning Engineer & Data ScientistLocation: Kolkata & Bhubaneswar / In-Person Interview (F2F)FulltimeJob Description:Be a hands on problem solver with consultative approach, who can apply Machine Learning & Deep Learning algorithms to solve business challengesa. Use the knowledge of wide variety of AI/ML techniques and algorithms to find...