Senior data engineer
4 weeks ago
About the Job We are seeking a highly skilled Senior Data Engineer – Data Acquisition (ODS) to join our data engineering team. The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformation pipelines using Azure Data Platform , Databricks , Snowflake , and Kafka . You will be responsible for designing, developing, and maintaining robust data acquisition frameworks that support large-scale analytics and operational data systems. Job Title Senior Data Engineer – Data Acquisition (ODS) Skills Kafka, Python, Spark, Databricks, SQL, Snowflake, Azure Data Factory (ADF), XML, JSON, Scala (Basic) Experience Required : 5+ Years Location: Remote Notice Period: Immediate to 15 Days Preferred Job Description Design, develop, and maintain data ingestion and transformation pipelines in an Azure-based environment. Work with Kafka for real-time data streaming and message queuing. Build scalable ETL/ELT pipelines using Databricks (Py Spark/Scala) and integrate with Snowflake for analytics workloads. Develop and optimize SQL queries and stored procedures for performance and data accuracy. Utilize Azure Data Factory (ADF) to orchestrate workflows and integrate with various data sources. Work with structured and semi-structured data formats such as XML, JSON, Parquet, and CSV . Collaborate with data architects, analysts, and business teams to deliver high-quality, reliable data pipelines. Ensure code quality, version control, and data security best practices are followed. Contribute to data architecture design discussions and provide technical recommendations for system improvements. Key Responsibilities End-to-end development of data acquisition solutions for operational and analytical systems. Implement data transformation logic using Spark and Python. Optimize performance of large-scale data pipelines in Databricks/Snowflake. Handle real-time and batch data ingestion via Kafka and ADF. Conduct data validation, profiling, and documentation of technical specifications. Qualification & Certification Bachelor’s degree in Computer Science, Information Technology, or related field. Microsoft Azure or Snowflake certification (preferred). Strong understanding of modern data engineering best practices. Good to Have Experience with Dev Ops tools and CI/CD pipelines for data deployment. Exposure to data modeling and data warehouse design . Familiarity with other streaming platforms or data orchestration tools. About Info Beans Info Beans is a global digital transformation and product engineering company, enabling businesses to thrive through innovation, agility, and cutting-edge technology solutions. With over 1,700 team members across the globe, we specialize in custom software development, enterprise solutions, cloud, AI/ML, UX, automation, and digital transformation services. At Info Beans, we live by our core purpose of “Creating WOW” — for our clients, team members, and the community. Our collaborative culture, growth opportunities, and people-first approach make us one of the most trusted and rewarding workplaces. ????
-
Senior Data Engineering Professional
7 days ago
kakinada, India beBeeDataEngineer Full time**Data Engineering Role Overview**We're seeking a highly skilled Senior Data Engineer to join our data and analytics team, supporting the development and enhancement of dimensional data models. This critical role will focus on financial reporting and analytics across the business.You'll work closely with stakeholders to understand complex financial concepts...
-
Senior Data Engineer
7 days ago
kakinada, India beBeeDataEngineer Full timeData Engineering RoleJob Title: Senior Data Engineer - Python ExpertWe are seeking a seasoned Senior Data Engineer to lead our data engineering efforts and build scalable, automated systems that transform massive, raw datasets into pristine, model-ready formats.Your primary mission will be to architect, build, and own robust, scalable, and automated ETL/ELT...
-
Data Engineer
7 days ago
kakinada, India beBeeData Full timeJob SummaryPrimesoft is looking for an experienced Data Engineer to join our team. As a key member of the Data Products group, you will be responsible for designing and developing data systems, including pipelines, APIs, analytics, AI, and machine learning at scale.This role emphasizes hands-on development, reliability, and collaboration with senior...
-
Senior Data Engineer
5 days ago
Kakinada, India Koantek Full timeWe are seeking an experienced Full Stack Data Engineer with 5–6 years of industry experience. The ideal candidate will have a proven track record of working on live projects, preferably within the manufacturing or energy sectors. He/she will play a key role in developing and maintaining scalable data solutions using PySpark, SQL, and modern data...
-
Senior Data Engineer – Power BI
5 days ago
Kakinada, India Innova ESI Full timeRole: Senior Data Engineer – Power BI / AzureLocation: Bangalore | Gurgaon | Pune | Noida | Hyderabad | ChennaiExperience: 5+ YearsImmediate Joiners Only5+ years of experience in Power BI development Design, develop, and maintain advanced Power BI dashboards and reports Experience with Azure Databricks or Azure Data factory and Spark Experience working...
-
Highly Skilled Data Engineering Specialist
3 days ago
kakinada, India beBeeDataEngineer Full timeAbout Our Senior Data Engineer RoleWe're seeking a highly skilled Senior Data Engineer to design, build and scale robust data solutions on Microsoft Azure.As a key member of our engineering team, you will own modern data pipelines and models that power analytics and reporting across the business.The ideal candidate will be hands-on with SQL databases, Azure...
-
Principal Data Engineer
7 days ago
kakinada, India beBeeData Full timeFoundry Engineer RoleJob Overview:This role presents a fantastic opportunity for a talented individual to work on a pivotal project utilizing Palantir Foundry and AIP. As part of our team, you will have the chance to design, build, and maintain scalable data pipelines, transformations, and applications within the Palantir ecosystem.Key...
-
Senior Cloud Data Specialist
5 days ago
kakinada, India beBeeData Full timeJob Title: Senior Cloud Data SpecialistOverviewSeeking a seasoned cloud data specialist to spearhead our team's big data strategy. The ideal candidate possesses in-depth knowledge of Google Cloud Platform (GCP) and experience with BigQuery, Airflow, and PySpark.Key ResponsibilitiesTechnical requirement gathering and development of functional specifications...
-
Sr data engineer
3 weeks ago
Kakinada, India Futran Solutions Full timeJob Title: Senior Data Engineer/ Data Engineer Lead Job Description: We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms. The ideal candidate will have a proven track record of designing, implementing, and managing large-scale data solutions using Azure technologies. This role...
-
Senior Cloud Data Specialist
7 days ago
kakinada, India beBeeDataEngineer Full timeJob TitleAzure Data Engineer - Full Remote Senior Position AvailableAbout the JobWe are currently looking for a highly skilled and experienced Azure Data Engineer to join our team. As a senior-level professional, you will be responsible for designing, building, and maintaining data pipelines for enterprise search applications using ADF and Databricks.The...