Luxoft | Data Engineer

3 weeks ago

udaipur, India Luxoft Full time

Project description

As a Senior Engineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies. The challenge will be to create high-performance algorithms, cutting-edge analytical techniques including machine learning and artificial intelligence, and intuitive workflows that allow our users to derive insights from big data that in turn drive their businesses. You will have the opportunity to create high-performance analytic solutions based on data sets measured in the billions of transactions and front-end visualizations to unleash the value of big data. You will have the opportunity to develop data-driven innovative analytical solutions and identify opportunities to support business and client needs in a quantitative manner and facilitate informed recommendations/decisions through activities like building ML models, automated data pipelines, designing data architecture/schema, performing jobs in big data cluster by using different execution engines and program languages such as Hive/Impala, Python, Java, Kafka, Spark, R, etc.


Responsibilities

-Hands-on developer who writes good quality, secure code that is modular, functional, and testable.

-Drive the evolution of Data & Services products/platforms with an impact-focused on data science and engineering.

-Design and implement scalable data architecture and data pipelines

-Solving complex problems with multi-layered data sets, as well as optimizing existing machine learning libraries and frameworks.

-Provide support for deployed data applications and analytical models by being a trusted advisor to Data Scientists and other data consumers by identifying data problems and guiding issue resolution with partner Data Engineers and source data providers.

-Ensure proper data governance policies are followed by implementing or validating Data Lineage, Quality checks, classification, etc.

-Discover, ingest, and incorporate new sources of real-time, streaming, batch, and API-based data into our platform to enhance the insights we get from running tests and expand the ways and properties on which we can test Experiment with new tools to streamline the development, testing, deployment, and running of our data pipelines.

-Participate in the development of data and analytic infrastructure for product development

-Continuously innovate and determine new approaches, tools, techniques & technologies to solve business problems and generate business insights & recommendations

-Partner with roles across the organization including consultants, engineering, and sales to determine the highest priority problems to solve

-Evaluate trade-offs between many possible analytics solutions to a problem, taking into account usability, technical feasibility, timelines, and differing stakeholder opinions to make a decision

-Break large solutions into smaller, releasable milestones to collect data and feedback from product managers, clients, and other stakeholders

-Evangelize releases to users, incorporating feedback, and tracking usage to inform future development

-Work with small, cross-functional teams to define the vision, establish team culture and processes

-Consistently focus on key drivers of organization value and prioritize operational activities accordingly

-Escalate technical errors or bugs detected in project work

-Maintain awareness of relevant technical and product trends through self-learning/study, training classes, and job shadowing.

-Support the building of scaled machine learning production systems by designing pipelines and engineering infrastructure.


Skills

Must have

-Working proficiency in using Python/Scala, Spark (tuning jobs), SQL, Hadoop platforms to build Big Data products & platforms.

-Good programming skills in Java and spring boot and Junit.

-Knowledge in software development test approaches & frameworks

-Familiarity with RESTful APIs and micro-services architectures

-Experience in working with CI/CD

-Experience in working with SQL database like Postgres, Oracle

-Preferably with hands-on experience with Hadoop big data tools (Hive, Impala, Spark)

-Experience with data pipeline and workflow management tools: NIFI, Airflow.

-Comfortable in developing shell scripts for automation.

-Good troubleshooting and debugging skills.

-Proficient in standard software development, such as version control, testing, and deployment

-Demonstrated basic knowledge of statistical analytical techniques, coding, and data engineering

-Ability to quickly learn and implement new technologies

-Ability to Solve complex problems with multi-layered data sets

-Ability to innovate and determine new approaches & technologies to solve business problems and generate business insights & recommendations.

-Ability to multi-task and strong attention to detail

-Flexibility to work as a member of a matrix based diverse and geographically distributed project teams

-Good communication skills both verbal and written and strong relationship, collaboration skills, and organizational skills.


Nice to have

-Experience with performance Tuning of Database Schemas, Databases, SQL, ETL Jobs, and related scripts

-Experience in working with Cloud APIs (e.g., Azure, AWS)

-Experience participating in complex engineering projects in an Agile setting e.g. Scrum

  • Data Engineer

    4 weeks ago

    Udaipur, India Trantor Full time

    Experience Required - 4-10 years of experience as Data EngineerLocation - Coimbatore (Onsite)Description● Experience in designing, building, and managing data infrastructure and pipelines, aswell as conducting analysis work to provide insights that will guide strategic decisions.Mandatory Skills● Strong proficiency in SQL and Python for data analysis,...

  • Data Engineer

    4 weeks ago

    Udaipur, India TIU Consulting Full time

    Hi,We are looking for Data engineers at Pune location to work hybrid.Experience level: 4 to 11 yearsLead time to join, if selected: Immediate to 15 daysMandatory experience: Scala, Spark, AWS, MongoDB/DocumentDB and strong hands on in coding.Role and Responsibility BriefBe part of a cross functional Scrum team that develops and supports the product. You will...

  • Senior Business Systems Analyst

    1 month ago

    Udaipur, India Luxoft Full time

    Project Description:Security is a global organization within Group Technology Infrastructure and Security Engineering on the Bank. Our services focus on access management for applications and infrastructure, identity management for users, directories, detecting/preventing measures for cyber threats, and exchanging/storing data securely. We provide...

  • Cloud Solutions Architect

    2 weeks ago

    Udaipur, Rajasthan, India Luxoft Full time

    Job DescriptionWe are seeking a highly skilled Cloud Solutions Architect to join our global technology team in Switzerland, Poland, and Singapore. As a key member of our organization, you will be responsible for designing, implementing, and managing data solutions on Azure.Key Responsibilities:Design and implement efficient data storage and retrieval...

  • Senior Data Engineer with Python Expertise

    2 weeks ago

    Udaipur, Rajasthan, India Tata Technologies Full time

    We are seeking a highly skilled Senior Data Engineer to join our team at Tata Technologies. In this role, you will be responsible for designing and delivering data platforms that meet the highest standards of quality, security, and scalability.Estimated Salary: $120,000 - $180,000 per yearAbout UsTata Technologies is a global leader in digital transformation...

  • Associate Software Engineer

    3 weeks ago

    Udaipur/Jaipur, India Kadel Labs Full time

    About Kadel Labs PVT LTD : Kadel Labs is a global software technology systems incubator. We began our operations in 2017 and we plan to grow organically by providing excellent value proposition to our clients. We are one stop solution and a platform for booming startups. It nurtures every startup from inception till it becomes a self-sustainable corporate...

  • Data Integration Architect

    3 weeks ago

    Udaipur, Rajasthan, India TalentBridge Full time

    TalentBridgeEstimated Salary: $120,000 per yearWe are seeking a Senior Engineer with a strong focus on API development and integrations and a background in eCommerce & supply chain.This role will be responsible for designing and implementing both internal and external APIs, leading integration efforts, and setting technical direction for key projects...

  • Data Insights Strategist

    4 weeks ago

    Udaipur, Rajasthan, India Even Full time

    About EvenEven is a leading Health-tech company that aims to revolutionize the healthcare system in India by prioritizing patients and doctors. We partner with top hospitals across the country to offer unlimited OPD and hospitalization services to our members, focusing on preventive healthcare and making it accessible and affordable.We envision a model of...

  • Data Pipeline Architect

    3 weeks ago

    Udaipur, Rajasthan, India TalentBridge Full time

    TalentBridge is seeking a skilled Data Pipeline Architect to join our team in India (Remote).Estimated salary: $160,000 - $220,000 per year.We are looking for a highly motivated and experienced professional to work with large, complex data pipelines, ensuring data integrity, scalability, and security. As a Data Pipeline Architect, you will be responsible for...

  • Searce Inc | Director

    3 weeks ago

    Udaipur, India Searce Inc Full time

    Who we are?Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’. It signifies our way of working: To improve to the finest degree of excellence, ‘solving for better’ every time. Searcians are passionate improvers & solvers who love to question the status quo.The primary purpose of all of us, at Searce, is driving...

  • Software Data Engineer Position in India

    3 weeks ago

    Udaipur/Jaipur, India Kadel Labs Full time

    About Kadel Labs PVT LTD : We are a global software technology systems incubator based in Udaipur/Jaipur, India. Our mission is to provide excellent value proposition to our clients and nurture every startup from inception till it becomes a self-sustainable corporate firm.We are seeking an experienced Software Data Engineer to join our team. As a key member...

  • Senior Data Integration Specialist

    3 weeks ago

    Udaipur, Rajasthan, India TalentBridge Full time

    TalentBridge Senior Data Integration SpecialistEstimated Salary: $120,000 - $180,000 per annumWe are seeking a highly skilled Senior Data Integration Specialist to join our team at TalentBridge. As an expert in API development and integrations, you will be responsible for designing and implementing internal and external APIs, leading integration efforts, and...

  • Senior Staff Software Engineer

    3 months ago

    udaipur, India Coinbase Full time

    At Coinbase, our mission is to increase economic freedom around the world, and we couldn’t do this without hiring the best people. We’re a group of hard-working overachievers who are deeply focused on building the future of finance and Web3 for our users across the globe, whether they’re trading, storing, staking or using crypto. Know those people who...

  • Sr. Data Scientist/Engineer: INR 18-30 LPA

    3 weeks ago

    Udaipur, India Zifcare Full time

    Our client is looking for data scientists and engineers to help build AI-powered solutions for the banking, manufacturing and other industries.Roles & responsibilities:Build data pipelines to automatically extract data from various databases containing structured and/or unstructured dataAnalyze and organize data to combine information coming from different...

  • DMAIC Academy

    3 weeks ago

    Udaipur, India DMAIC Academy & Consultancy Full time

    Position:Data ModelerExperience:10+ YearsLocation:Pune/Bangalore – HybridNotice Period:Immediate to 15 DaysNote:Candidates must have hands-on experience as Data Modelers or Data Architects specializing in Snowflake.Job Description:Core Knowledge:Expert in business data models (conceptual, logical, physical).Strong database design (relational, dimensional)...

  • Python Engineering Manager

    3 weeks ago

    Udaipur, Rajasthan, India Arting Digital Full time

    At Arting Digital, we're committed to delivering top-notch digital solutions. As a Python Engineering Manager, you will oversee the development of our applications, ensuring they meet the highest standards of quality and scalability.You'll lead a team of skilled engineers, guiding them to build and maintain Python applications using web frameworks like...

  • Electrical Engineer

    3 months ago

    Udaipur, India Tecnicas Reunidas Full time

    Técnicas Reunidas is a world-leading international general contractor engaged in the engineering and construction of industrial facilities in the fields of Oil & Gas, Petrochemicals, Power Generation, Energy Transition, Infrastructures and industries, etc. Tecnicas Reunidas has worked and built all over the world, in 60 countries of the 5...

  • Cloud Data Insights Specialist

    2 weeks ago

    Udaipur, Rajasthan, India Syncpoint360 Full time

    Job Description:We are seeking a highly skilled Cloud Data Insights Specialist to join our team at Syncpoint360. As a key member of our data analytics team, you will be responsible for providing insights and actionable recommendations to drive business growth.Responsibilities:Analyze large datasets hosted on cloud platforms such as AWS, Azure, and Google...

  • Senior Process Engineer

    6 days ago

    Udaipur, India Sofomation Full time

    OPENING FOR A WELL KNOWN OIL AND GAS COMPANY IN MIDDLE EAST:Position: Process Engineer - NHT/CCR Process Optimization Experience: 15 years of experience in process engineering, with at least 10 years of hands-on technical experience in NHT and CCR optimization within a refinery environment, and at least 5 years in a technical role focused on process...

  • Advanced Oracle E-Business Suite Data Integration Specialist

    3 weeks ago

    Udaipur, Rajasthan, India TalentBridge Full time

    TalentBridge: Top IT Consultant OpportunityEstimated Salary: $100,000 - $140,000 per yearWe are seeking a Senior Engineer with a strong focus on API development and integrations and a background in eCommerce & supply chain. This role will be responsible for designing and implementing both internal and external APIs, leading integration efforts, and setting...