
Big Data Engineer with Cloud Expertise
2 weeks ago
Job Description:
">We are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have hands-on expertise in designing, developing, and optimizing large-scale data processing solutions using Py Spark, Python, SQL, and real-time data streaming.
">Key Responsibilities:
">- ">
- Design, develop, and optimize data pipelines using Py Spark, Spark, and Python">
- Implement ETL/ELT solutions to integrate structured and unstructured data from multiple sources">
- Develop and maintain Hive queries and ensure seamless data transformations">
- Write and optimize SQL queries for large datasets">
- Build, monitor, and support real-time streaming solutions using Apache Kafka">
- Work on Databricks to create, manage, and optimize data workflows">
- Deploy and manage solutions in Azure cloud services (e.g., Data Lake, Synapse, Azure Databricks)">
Required Skills & Qualifications:
">- ">
- 3–4 years of experience in data engineering with a focus on Py Spark and Python">
- Strong knowledge of Spark, Hive, SQL, and Unix shell scripting">
- Experience with Databricks in a production environment">
- Hands-on experience with Azure cloud services (preferred: Data Lake, Synapse, Databricks)">
- Experience working with Apache Kafka or other real-time streaming technologies">
- Strong problem-solving and debugging skills">
- Excellent written and verbal communication skills">
- Ability to work independently in a fast-paced environment and adapt to new technologies quickly">
Nice-to-Have Skills:
">- ">
- Exposure to CI/CD pipelines for data solutions">
- Knowledge of data governance and security best practices">
- Experience with Agile/Scrum methodology">
Benefits:
">This role offers the opportunity to work on challenging projects and collaborate with cross-functional teams to deliver high-quality data-driven solutions.
">Location: Remote, India
">Job Type: Contract
">Salary: Competitive salary package
"]}],-
Big Data Developer
2 weeks ago
Hubli, Karnataka, India Tech Consulting Full timePosition Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers.This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You will...
-
Senior Data Engineer
2 weeks ago
Hubli, Karnataka, India Deltacubes Full timeJob description:• Develop, construct, test and maintain data acquisition pipelines for large volumes of structed and unstructured data. This includes batch and real-time processing (in google cloud)• Build large and complex datasets based on business requirements• Construct 'big data' pipeline architecture• Identify opportunities for data acquisition...
-
Senior Cloud Data Engineer
2 weeks ago
Hubli, Karnataka, India beBeeCloudEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000Senior Data Engineer - Cloud InfrastructureWe are seeking a seasoned Senior Data Engineer to lead our cloud infrastructure initiatives on AWS. As a key member of our team, you will be responsible for designing, developing, and deploying end-to-end data pipelines using AWS services.This is an exceptional opportunity to leverage your technical expertise in...
-
Data Engineering Specialist
2 weeks ago
Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,00,000Job Title: Data Engineering SpecialistJob Description:We are seeking an experienced Data Engineer with hands-on expertise in Python and Pyspark to join our team. As a key member, you will be responsible for implementing a data-driven solution for a large retailer.Required Skills & Qualifications:5+ years of experience as a Data EngineerExpertise in Python,...
-
Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,55,00,000Job Title: Data EngineerSummary:The ideal candidate will have 4+ years of IT experience, with good exposure into diagnosis and troubleshooting complex issues in cloud-based data platforms.Key Responsibilities:Develop and maintain ETL processes and data engineering using SQL and Looker/Look MLImplement monitoring and logging solutions to ensure seamless data...
-
Data Architect
3 weeks ago
Hubli, Karnataka, India MGrow Full timeExperience Level: 10+ YearsWho We AreArtefact is a new generation of a data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we're enjoying skyrocketing growth.Our broad range of data-driven solutions in...
-
Pyspark Data Engineer
2 weeks ago
Hubli, Karnataka, India BLS360 Full timeRole OverviewThis is a contract remote role.We are seeking a highly motivated Py Spark Data Engineer with 3–4 years of experience in building, optimizing, and maintaining large-scale data processing solutions.The ideal candidate will bring hands-on expertise in Py Spark, Python, SQL, and real-time data streaming and will contribute to the design and...
-
AWS Cloud Engineer
3 weeks ago
Hubli, Karnataka, India Jase HR Solutions Full timeLooking for a proficient AWS Cloud Engineer. In this role, you will play a key role in designing, deploying, and managing AWS cloud solutions that align with our organizational objectives. You will leverage your expertise in AWS technologies to build scalable, secure, and robust cloud architectures, ensuring optimal performance and efficiency.Key...
-
Data Management Solutions Specialist
2 weeks ago
Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Big Data EngineerWelcome to our organization, where we're shaping the future of data management.As a seasoned Data Engineer, you'll lead our team in implementing cutting-edge infrastructure solutions using code and provide strategic guidance on Microsoft Azure technologies. With 5-7 years of experience, you'll integrate and automate standardized Azure...
-
Senior backend engineer
4 weeks ago
Hubli, Karnataka, India Rayole Software Full time???? We're Hiring: Senior Backend Engineer ????Location: RemoteEmployment Type: Full-TimeExperience Level: SeniorAre you an experienced Backend Engineer with a passion for building scalable, high-performance applications? We're looking for a highly skilled Senior Backend Engineer with extensive expertise in Python, Django, Next.js, Node.js, React, and web...