Senior Data Engineer
3 months ago
Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect
Experience: 3-15 years
Location: Bangalore, Chennai, Delhi, Pune, Kolkata and Gurgaon
Mandatory Skills: Python/ PySpark / Spark with Azure/ Azure Databricks / Azure DataFactory
Primary Roles and Responsibilities:
● Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack
● Ability to provide solutions that are forward-thinking in data engineering and analytics space
● Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
● Triage issues to find gaps in existing pipelines and fix the issues
● Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
● Help joiner team members to resolve issues and technical challenges.
● Drive technical discussion with client architect and team members
● Orchestrate the data pipelines in scheduler via Airflow
Skills and Qualifications:
● Bachelor's and/or master’s degree in computer science or equivalent experience.
● Must have total 3+ yrs. of experience in Data warehouse/ETL projects.
● Deep understanding of Star and Snowflake dimensional modelling.
● Strong knowledge of Data Management principles
● Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
● Should have hands-on experience in SQL, Python and Spark (PySpark)
● Candidate must have experience in AWS/ Azure stack
● Desirable to have ETL with batch and streaming (Kinesis).
● Experience in building ETL / data warehouse transformation processes
● Experience with Apache Kafka for use with streaming data / event-based data
● Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
● Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
● Experience working with structured and unstructured data including imaging & geospatial data.
● Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
● Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
● Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
● Should have experience working in Agile methodology
● Strong verbal and written communication skills.
● Strong analytical and problem-solving skills with a high attention to detail.
-
Senior Data Strategist
1 week ago
Solapur, Maharashtra, India Unico Connect Full timeJob SummaryWe are seeking a highly skilled Senior Data Strategist to join our innovative team at Unico Connect. As a key member of our data science group, you will play a critical role in shaping data-driven strategies that drive business success.
-
Data Engineer
1 week ago
Solapur, India Truelancer.com Full timeJob Title: AWS Data EngineerExperience: 8-12 YrsMust Have Skills: Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWSRequired Skills:8-12 years of experience in Data EngineeringCreation and maintenance of optimum data pipeline architecture for ingestion, processing of dataCreation of necessary infrastructure for ETL jobs from a wide range of...
-
Senior Data Specialist
4 weeks ago
Solapur, India Black Panda Enterprises Full timeJoin Forage AI as a Senior Data Specialist. If you’re a detail-oriented, communication, and research-savvy professional who loves working with data, then this may be the right role for you!As a senior data specialist, you will play a critical role in managing processes and collaborating with other teams. You will also ensure the accuracy, integrity, and...
-
Data Engineering Lead
3 weeks ago
Solapur, Maharashtra, India Azilen Technologies Full timeCompany OverviewAzilen Technologies is a leading technology firm that specializes in data engineering and analytics solutions.Job SummaryWe are seeking an experienced Data Engineering Lead to join our team. As a key member of our data engineering group, you will be responsible for designing and developing scalable data pipelines, ensuring high-quality data...
-
Big Data Engineer
1 month ago
Solapur, India Pert Telecom Solutions Full timeJob Description: We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...
-
Data Analytics Engineer
3 weeks ago
Solapur, India MPC Cloud Consulting Pvt Ltd Full timeWe are looking for Data Analytics Engineers Key Details:Role: Data Analytics Engineer (5-8 years of experience, ability to work independently) Skillset: Azure Data Factory, Azure Synapse Analytics, and other Azure services. SQL Server, Azure SQL Python software development stacks, ecosystems, frameworks, and tools such as NumPy, SciPy, Pandas, sci-kit-learn...
-
Data Science Engineer
3 weeks ago
Solapur, India RecourseTech Full timeRecourse Tech is a dynamic and fast-growing software and technology agency that builds cutting-edge solutions for businesses across industries. We specialize in delivering high-impact, data-driven solutions, leveraging advanced technologies, and empowering organizations with actionable insights.We are looking for a Data Science Engineer with 1-3 years of...
-
Senior Teamcenter Data Migration Specialist
2 weeks ago
Solapur, Maharashtra, India PLMITPro Full timeJob DescriptionWe are seeking a highly skilled Senior Teamcenter Data Migration Specialist to join our team at PLMITPro.This is a unique opportunity to leverage your expertise in Teamcenter data migration, Requirements Gathering, Solution Design, and implementation knowledge to drive business growth.About the RoleDevelop and implement efficient data...
-
Sr. Data Architect-Contract
3 weeks ago
Solapur, India Gravity Infosolutions Full timeRole: Sr. Data Architect-ContractExperience: 14-20 yearsShift: Regular IST shiftType: ContractDuration: 6 monthsLocation: Mumbai-Hybrid(2 Days Work from Office in a week)Job Description:We are seeking an accomplished Senior Data Architect to join our team and lead our data architecture efforts. As a Senior Data Architect, you will be responsible for...
-
Senior Java Software Engineer
6 months ago
solapur, India SPIRO Full timeWe are looking for an experienced Senior Java Developer to join our dynamic and growing team. The ideal candidate will have a strong background in Java development and a passion for building high-quality software solutions. You will be responsible for designing, developing, and maintaining Java applications that are efficient, reliable, and scalable. Key...
-
Solapur, Maharashtra, India Hexaware Technologies Full timeHexaware Technologies is a leading IT consulting and business solutions company that offers end-to-end services to clients worldwide. Our team of experts provides innovative solutions to businesses, helping them achieve their goals and stay ahead in the market.We are seeking an experienced Snowflake Data Engineer who will play a key role in designing,...
-
Data Engineering Expert for Revenue Growth
4 weeks ago
Solapur, Maharashtra, India Cardinal Health Full timeAbout UsAt Cardinal Health, we are a leading distributor of pharmaceuticals and a global manufacturer and distributor of medical and laboratory products. We strive to be the most trusted partner in healthcare by delivering innovative digital solutions and end-to-end services that advance healthcare and improve lives.We have a long history of success, with...
-
Senior Embedded Software Engineer
3 weeks ago
Solapur, India Fluidech Full timeJob Title: Senior Embedded/Platform Software TesterCompany Profile:Fluidech is a technology consulting and managed services firm specializing in infrastructure (cloud & on-premise), automation (DevOps and RPA), and cybersecurity. Our name, 'Fluidech,' reflects our approach—combining 'fluid' with 'technology' to emphasize our adaptable and innovative...
-
Senior Staff Engineer
5 months ago
Solapur, India Mulya Technologies Full timeSenior Staff Engineer - RTL DesignLocation: Bangalore /Pune We enable tomorrow’s future by accelerating the critical data communication at the heart of our digital world – from seamless video streaming to AI to the metaverse and much more. Our technology powers product innovation in the most data-demanding industries today, including data centers,...
-
Senior Staff Software Engineer
3 months ago
solapur, India Coinbase Full timeAt Coinbase, our mission is to increase economic freedom around the world, and we couldn’t do this without hiring the best people. We’re a group of hard-working overachievers who are deeply focused on building the future of finance and Web3 for our users across the globe, whether they’re trading, storing, staking or using crypto. Know those people who...
-
Principal Data Scientist
4 months ago
Solapur, India v4c.ai Full timeOverview: As the apex of the data science hierarchy, the Principal Data Scientist will set the strategic direction for data-driven initiatives, ensuring alignment with organizational goals, and lead in the adoption of advanced technologies including Machine Learning, Deep Learning, and Generative AI.Job Description:Strategically lead the planning and...
-
Data Governance
2 months ago
Solapur, India Deloitte Full timeWe are looking for Candidates who are having experience as Data GovernanceExperience Required: 3 - 20 years.Location: PAN IndiaResponsibilities:--Expertise: Data Governance Senior Manager- Minimum of 12 years of experience in data management and data governance and must have knowledge in informatica EDC or Axon- Demonstrated management of strategic and...
-
Data Modeler
7 days ago
Solapur, India Akshya Patra Services Full timeWe are seeking a highly skilled and experienced Data Modeller to join our growing data team.In this role, you will be responsible for designing and developing robust and scalable data models that effectively capture and represent business information.You will work closely with data engineers, analysts, and business stakeholders to translate complex business...
-
Data Analyst
4 weeks ago
Solapur, India snooplay.in Full timeLocation: Noida (Full time)Education: B.Tech (preferred)About Snooplay:Snooplay is India’s leading marketplace for toys and games, where data drives every decision. With multiple data nodes fueling our platform, we rely on meaningful insights to improve experiences for parents and children. If you’re passionate about digging into data, deriving patterns,...
-
Senior Software Engineer
4 weeks ago
Solapur, India Intuit Full timeEmbark on a thrilling journey with Intuit, a leader in financial management solutions, as a Mobile Software Developer in our buzzing Bangalore hub. TurboTax, a household name, delivers cutting-edge tax software that makes filing stress-free and straightforward for millions of users across the globe.About Your Team:QuickBooks is the flagship accounting...