Databricks Developer
1 month ago
Job Description :
- Design, develop, and maintain data pipelines and workflows using Databricks.
- Create and manage ETL processes to ingest, process, and store large volumes of data.
- Develop and optimize Spark jobs and notebooks for efficient data processing.
Data Engineering :
- Work with large datasets and perform data transformations, aggregations, and analysis.
- Implement and manage data storage solutions in Databricks and Azure/AWS/GCP.
- Design and implement data models and schema changes as needed.
Collaboration :
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Provide technical support and guidance to team members and stakeholders on data-related issues.
Optimization and Performance :
- Monitor and optimize the performance of data pipelines and Spark jobs.
- Implement best practices for data governance, security, and quality.
Documentation and Reporting :
- Maintain clear documentation of data processes, architecture, and workflows.
- Create and present reports and dashboards to communicate findings and insights.
Qualifications :
- Education: Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field. Advanced degrees or certifications are a plus.
Experience :
- Proven experience as a Databricks Developer or similar role with strong expertise in Databricks and Spark.
- Hands-on experience with cloud platforms such as Azure, AWS, or GCP.
- Solid understanding of data modeling, ETL processes, and data warehousing concepts.
Technical Skills :
- Proficiency in Spark, Databricks, and related technologies.
- Strong programming skills in Python, Scala, or SQL.
- Experience with data integration tools and frameworks.
- Knowledge of big data technologies and data storage solutions.
Soft Skills :
- Excellent problem-solving and analytical skills.
- Strong communication and teamwork abilities.
- Ability to manage multiple tasks and work in a fast-paced environment.
Preferred Skills :
- Experience with machine learning and data science workflows.
- Familiarity with DevOps practices and tools related to data engineering.
- Knowledge of data privacy regulations and best practices
-
Azure Databricks Developer
1 month ago
Kolkata/Mumbai/Hyderabad, IN Selsoftinc Full timeRole : Data Bricks DeveloperExperience : 5+Years Location : Kolkata , Mumbai , HyderabadLocation : Job Summary : We are seeking a proficient Databricks Developer to design, build, and maintain scalable data pipelines. The ideal candidate will work closely with data scientists and business stakeholders to deliver high-quality data solutions.Key...
-
Azure Databricks Developer
1 month ago
Hyderabad/Kolkata/Mumbai, IN Selsoft Full timeRole : Data Bricks DeveloperLocation : Hyderabad, Mumbai, kolkataExperience : 5+yearsJob Summary :We are seeking a proficient Databricks Developer to design, build, and maintain scalable data pipelines. The ideal candidate will work closely with data scientists and business stakeholders to deliver high-quality data solutions.Key Responsibilities :- Develop...
-
Data Engineer
6 months ago
Pune/Hyderabad, IN EDGESOFT Full timeJob Description :The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...
-
Bangalore/Chennai/Hyderabad, IN Hirist.tech Full timeResponsibilities :1. Role : Senior Databricks Engineer 2. Skills and Experience :- Extensive expertise in Databricks and Azure Data Factory (ADF).- Good understanding of Azure Synapse Analytics, ADLS, Azure SQL Server, Azure Logic Apps, APIs, Unity Catalog, Delta Lake, T-SQL, and Python.- Knowledge of Power BI connectors.3. Responsibilities :- Design,...
-
Senior Azure Data Engineer
1 month ago
Bangalore/Pune/Chennai/Hyderabad, IN Foundit Full timeJob Description :Tech Skills Required :- Minimum 5 years of experience with Azure development and data solutions.- High proficiency with Azure data technologies (Azure Data Factory, Databricks, Azure Synapse Analytics).- Strong proficiency in SQL and writing complex data queries.- Deep experience in all stages of Data Analysis, including data source...
-
Data Engineer
1 month ago
Bangalore/Hyderabad/Chennai, IN Rigel Networks Pvt Ltd Full timeKey Responsibilities :- Design, develop, and maintain data pipelines using Python and Snowflake.- Implement data ingestion, transformation, and processing solutions leveraging Azure Databricks or Azure Data Factory.- Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.- Optimize and tune Snowflake...
-
Lead Azure Data Engineer
4 months ago
Navi Mumbai/Pune/Bangalore, IN Techno Wise Full timeJob Summary : We are seeking a highly skilled and motivated individual to join our team as a Senior Azure Data Engineer. The ideal candidate will have a strong background in Azure data technologies, a proven track record of ability to design and implement scalable and efficient data solutions.Responsibilities :- Design, develop, and deploy data pipelines and...
-
Azure Data Engineer
1 month ago
Anywhere in India/Multiple Locations/Mumbai/Bangalore/Hyderabad/Kolkata/Chennai/Pune/Bhubaneshwar/Na, IN Talpro Full timeJob Description : We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL. As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure SQL....
-
Data Platform Lead
1 month ago
Hyderabad/Mumbai, IN Aptusdatalabs Technologies Pvt. Ltd Full timeCompany Description : Aptus Data Labs is an innovative Data & AI Company offering analytical solutions and consulting services to help businesses make data-driven decisions. We leverage primary data, data management technologies, Data Science, and Decision Science to provide insights and identify risks and opportunities for our clients across various...
-
Nuviso Networks
1 month ago
Hyderabad/Chennai/Bangalore, IN Nuviso Networks Full time1. Data Engineering & Development :- Design, develop, and maintain scalable data pipelines using Azure Databricks.- Implement ETL processes to ingest and transform data from various sources.2. Data Management :- Develop and maintain Delta Lake tables for efficient data storage and retrieval.- Ensure data quality and integrity through rigorous testing and...
-
Scala/Spark Developer
1 month ago
Mumbai/Hyderabad/Chennai/Pune/Bangalore, IN Monster.com Full timeJob Description :Skill : Scala and SparkMainly Scala + Spark experience needed.- 5+ years of experience- Expertise in Data Engineering. - Hands-on experience in design and development of big data platform.- Deep understanding of modern data processing technology stacks : Spark, HBase, Hive and other Hadoop ecosystem technologies. - Development using Scala.-...
-
PySpark/Databricks Engineer
6 months ago
Anywhere in India/Multiple Locations/Hyderabad/Srinagar/Jaipur, IN Aricent Full timeJob : PySpark/Databricks EngineerOpen for Multiple Locations with WFO and WFHJob Description :We are looking for a PySpark solutions developer and data engineer that is able to design and build solutions for one of our Fortune 500 Client programs, which aims to build a data standardized and curation-based Hadoop clusterThis high visibility, fast-paced key...
-
Scala/Spark Developer
1 month ago
Mumbai/Pune/Bangalore, IN Xoriant Solutions Full timeWe are eagerly seeking candidates with 5 to 9 years' experience for a Spark & Scala Developer to join our dynamic team. The ideal candidate will play a pivotal role for our business in delivering data and insights to our clients. We're driving the company's digital transformation and expanding business capabilities using industry best practices...
-
Data Engineer
1 month ago
Hyderabad/Bhubaneshwar, IN TALENTOV Full timeJob Title : Senior Data EngineerLocation : Hyderabad/BhubhaneshwarJob Summary :We are seeking a skilled and experienced Senior Data Engineer to join our dynamic data team. The ideal candidate will have a strong background in data engineering, data warehousing, and a proven track record of implementing scalable data solutions. You will work closely with data...
-
Big Data Engineer
1 month ago
Bangalore/Pune/Mumbai/Chennai, IN a client of change leaders Full timeJob Description : - 5+ years of experience developing scalable Big Data applications or solutions on distributed platforms- Design and implement data pipelines using Snowflake, PostgreSQL, and Python.- Experience in AWS/ Azure/ GCP and good to have other cloud platform tools- Experience working with Big Data platforms, including Hadoop- Hive, Data Bricks...
-
Machine Learning Engineer
1 month ago
Mumbai/Pune/Bangalore, IN Techno Wise Full timeJob Description :We are seeking a talented and accomplished Machine Learning Engineer with expertise in Azure and Databricks. The ideal candidate will have a strong foundation in machine learning, deep learning, and artificial intelligence, with a proven track record of developing and deploying models in real-world applications. This role requires hands-on...
-
Big Data Engineer
1 month ago
Hyderabad/Pune/Delhi NCR, IN Ace Recruit Full timeJob Description :As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure. On a typical day, you might :- Design and build scalable & metadata-driven data ingestion...
-
PySpark Developer
1 month ago
Pune/Bangalore/Chennai/Hyderabad/Mysore, IN Vtricks Technologies Full timeJob Title : PySpark Developer Location : Pune, Bangalore, Chennai, Hyderabad, MysoreMode of Work : Onsite/HybridNotice Period : Immediate to 10 daysJob Description :We are looking for an experienced PySpark Developer with strong hands-on experience in working with Data Frames and the PySpark development process using Azure services. The ideal candidate...
-
Machine Learning Engineer
4 weeks ago
Mumbai/Bangalore/Pune/Chandigarh/Gurgaon/Gurugram, IN Techno Wise Full timeKey Responsibilities :1. Lead Machine Learning Projects :Take full ownership of machine learning projects from start to finish, including problem definition, data collection, model development, and deployment.2. Algorithm Development : Develop and optimize machine learning algorithms using techniques such as deep learning, natural language processing,...
-
Data Engineer
1 month ago
Mumbai/Bangalore/Pune/Chennai/Hyderabad, IN Changeleaders Full timeCompany Overview :Tech Mahindra is a leading provider of digital transformation, consulting, and business re-engineering services and solutions. We leverage next-generation technologies to help our clients achieve their business objectives.Job Summary :We are looking for an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will be...