Senior Data Engineer

3 days ago

Hubli, India EXL Full time

Key Responsibilities: • Develop high quality, secure and scalable data pipelines using spark, Scala/Python/Java on Hadoop or object storage like MinIO. • Leverage technologies and solutions to innovate with increasingly large data sets. • Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration. • Understand, implement and enforce Software development standards and engineering principles in the Big Data space. • Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency. • Perform assigned tasks and production incident independently. Must Have: • 5-9 years of experience in Data Warehouse/Data Lake/Lake House related projects in product or service-based organization • Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment handling petabyte scale data. • Solid Experience of building complex data pipelines through Spark with Scala/Python/Java on Hadoop or Object storage • Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge. • Proficient in working within an Agile/Scrum framework, including creating user stories with well-defined acceptance criteria, participating in sprint planning and reviews • Write and maintain Unix shell scripts, Oracle SQL, PL/SQL, and perform SQL tuning. • Optimize and troubleshoot Spark applications for performance, scalability, and fault tolerance • Use Git-based version control systems and CI/CD pipelines (e.g., Jenkins). • Implement and manage HIVE external tables, partitions, and various file formats. • Work across on-premises and cloud environments (AWS, Azure, Databricks). • Strong experience with Hadoop ecosystem and Cloudera Data Platform (CDP). Experience of building Nifi pipelines.Preferred • Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan • Strong communication skills - both verbal and written. • Ability to multi-task across multiple projects, interface with external / internal resources. • Proactive, detail-oriented and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results • Willingness to quickly learn and implement new technologies, participate POC to explore best solution for the problem statement • Experience working diverse and geographically distributed project teams. Skills & Qualifications: Bachelor’s degree in information systems, Information Technology, Computer Science or Engineering or equivalent work experience.

  • Senior Data Engineer

    2 weeks ago

    Hubli, India Guidanz Inc Full time

    About BI ConnectorBI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL. Our Data Architecture and Reporting Solutions team extends this mission by helping enterprises unlock the full value of their Oracle Fusion ERP, SCM, HCM data...

  • Senior Data Engineer

    6 days ago

    Hubli, India Whatjobs IN C2 Full time

    Job Summary Kogta Financial Ltd. is seeking an experienced and highly skilled ETL & Data Warehouse Developer with strong expertise in AWS data services . As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on the AWS platform. The ideal candidate...

  • Data Engineer

    1 week ago

    Hubli, India Sapphire Software Solutions Inc Full time

    HI FolksPlease check the JD and share your updated resume to my email naresh@sapphiresoftwaresolutions.com and ping me on whatsapp (+91 970-529-6474) along with your resumeData Engineer100% Remote1 year contractJOB DESCRIPTIONA global law firm with nearly 1,400 lawyers and more than 3,000 employees across 19 offices in the United States, Europe, and Asia is...

  • Data Engineer

    2 days ago

    Hubli, India Whatjobs IN C2 Full time

    Job Title: Data Engineer Location: Hyderabad / Chennai (Hybrid) Experience: 6–10 Years (STRICTLY) Employment Type: Permanent Notice Period: Immediate Joiners Only (≤15 days) Skills Required: Python, PySpark, AWS / Snowflake About the Company Our client is a global leader in IT and business services, operating in 50+ countries . They specialize in cloud,...

  • Senior AI

    5 days ago

    Hubli, India engineersmind Full time

    Role: Senior AI & Automation EngineerLocation: Bengaluru (Hybrid)Experience:5+yearsDepartment: Quality Engineering & Product AssuranceCompany: EngineersmindAbout the RoleWe’re seeking a highly driven Senior Software Test Engineer who takes complete ownership of product quality—from concept to customer delivery. You’ll be responsible for end-to-end...

  • Senior AI

    5 days ago

    Hubli, India engineersmind Full time

    Role: Senior AI & Automation EngineerLocation: Bengaluru (Hybrid)Experience:5+yearsDepartment: Quality Engineering & Product AssuranceCompany: EngineersmindAbout the RoleWe’re seeking a highly driven Senior Software Test Engineer who takes complete ownership of product quality—from concept to customer delivery. You’ll be responsible for end-to-end...

  • Data Engineer

    1 week ago

    Hubli, India People Prime Worldwide Full time

    About Company:-A leading global information technology, consulting, and business process services organization, the company delivers innovative solutions that enable clients across industries to thrive in the digital era. With a strong focus on technology-driven transformation, it helps enterprises harness the power of cloud, AI, automation, and analytics to...

  • Senior Engineer

    2 weeks ago

    Hubli, Karnataka, India Leameng Solution Technologies Full time ₹ 7,20,000 - ₹ 9,60,000 per year

    We are looking for a Senior Design Engineer with 3–8 years of experience in product/design engineering. Qualification: B.E./Diploma in Mechanical. The role involves design, drafting, and development using CAD tools. Location: Hubli. Salary range: ₹30,000 – ₹80,000 per month.Job Type: Full-timePay: ₹30, ₹80,000.00 per monthBenefits:Provident...

  • Data Engineer

    1 week ago

    Hubli, India Deloitte Full time

    Your potential, unleashed.India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realise your potential amongst cutting edge leaders, and organisations shaping the future of the region, and indeed, the world beyond.At Deloitte, your whole self to work, every day. Combine that with our...

  • Data engineer ii

    2 weeks ago

    Hubli, India ClearDemand Full time

    Job Summary: Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our data collection and analytics platform, capable of handling terabyte-scale data and billions of data points. Key Responsibilities Lead the design,...