Current jobs related to Java Spark Big Data Engineer - Bengaluru, Karnataka - Cognologix

  • Staff Data Engineer

    2 months ago

    Bengaluru, Karnataka, India Leading-Biotechnology-Company Full time

    We are seeking a highly experienced Staff Data Engineer with 10+ years of experience to join our talented team in Bangalore. This position will lead our data engineering efforts in Bangalore. In this strategic role, you will be responsible for designing, implementing, and optimizing complex data solutions using Python, Spark, SQL, Snowflake, dbt, machine...

  • Data Engineer

    2 months ago

    Bengaluru, Karnataka, India Talent500 Tech Full time

    We are Talent500:We help companies hire, build and manage global teams. We are trusted by the worlds leading companies - from Fortune 500s and larger enterprises (Walmart, Target, Nike, Pepsi etc) to industry leaders (Airbnb, Twitter, Uber) and some of the worlds fastest-growing start-ups from the portfolios of investors such as Accel, Sequoia and...

  • Lead Engineer

    3 months ago

    Bengaluru, Karnataka, India Kenvue Full time

    The Data Platform Administratoris responsible for leading software design, service architecture, and software development/solution engineering. You will manage junior engineers, lead design and code reviews within the service, and investigate emerging technologies to drive continuous improvement of the service:Key Responsibilities:Administer, configure, and...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India globalinsurance Full time

    Technology at Brit:Brit has a leadership position at Lloyds, the most well-known insurance market in the world. At Brit, we believe that the uncertainty of the future should never stand in the way of progress. Thats why we exist. To help people and businesses face the future and thrive.We are change-makers enabled by a global workforce who collaborate to...

  • Lead Data Engineer

    3 months ago

    Bengaluru, Karnataka, India Delta Air Lines Full time

    Key Responsibilities:Create, construct, and manage data pipelines with AWS services including S3, Glue, EMR, and Redshift.Use Kinesis, Stream, and Firehose to implement batch and stream data loading.For infrastructure as code, use AWS CDK to ensure scalability and dependability.Improve the effectiveness and performance of SQL queries.Write Python and other...

  • Lead Data Engineer

    1 month ago

    Bengaluru, Karnataka, India Delta Air Lines Full time

    About Delta Tech Hub:Delta Air Lines (NYSE: DAL) is the U.S. global airline leader in safety, innovation, reliability and customer experience. Powered by our employees around the world, Delta has for a decade led the airline industry in operational excellence while maintaining our reputation for award-winning customer service. With our mission of connecting...

  • Developer - Data Engineering

    1 month ago

    Bengaluru, Karnataka, India 3M Technology Center of Excellence Full time

    Developer - Data Engineering is a part of the Data & Analytics function to work on designing, developing, testing, and supporting Digital Data Core pipelines and complex data models development in Amazon Web Services (AWS) and deliver insights to the business.Primary Responsibilitiesinclude but are not limited to the following:Designs, develops, and...

  • Sr Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Leading-Biotechnology-Company Full time

    Senior Data EngineerJOB DUTIES:Design and architect data lake solutions on AWS S3 and Snowflake, considering scalability, automation, security, and performance requirements.Responsible for architecting, building, and optimizing data lake to store, process and analyze large volumes of structure and unstructured data.Requirements gathering and analysis,...

  • Lead Engineer

    3 months ago

    Bengaluru, Karnataka, India Kenvue Full time

    The CPD Data Engineering Architect is responsible for analyzing and designing technology solutions to meet business needs.Key Responsibilities:Design and implement scalable and efficient data pipelines to support business needsCollaborate with cross-functional teams to identify and solve complex data-related problemsDevelop and maintain data architecture and...

  • Data Engineer

    4 months ago

    Bengaluru, Karnataka, India arko Full time

    Job Description:We are seeking a skilled Data Engineer with 5-8 years of experience to join our team. The ideal candidate will have expertise in Power BI data modelling, master data management, data warehousing, and Azure data platform technologies. If you have a passion for transforming data into actionable insights and driving business decisions, we want...

  • Associate Engineer III

    3 months ago

    Bengaluru, Karnataka, India lululemon India Tech Hub Full time

    Associate Engineer (Backend) Retail Technology Job DescriptionWho we are ?lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being...

  • Staff Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Leading-Biotechnology-Company Full time

    JOB DUTIES:Translate business requirements into data requirements, data warehouse design and sustaining data management strategies on enterprise data platforms like Snowflake.Work with project leads, stakeholders, and business SMEs to define technical specifications to develop data modeling requirements and maintain data infrastructure to provide business...

  • Engineer I

    2 months ago

    Bengaluru, Karnataka, India lululemon India Tech Hub Full time

    Engineer IRegion:India State:KarnatakaCity:BangaloreDescription & Requirements:Who We Are ?We are proud to be a growing global company with locations all around the world, from Vancouver to Shanghai, and places in between. We owe our success to our innovative product, our emphasis on our stores, our commitment to our people, and the incredible connections we...

  • Senior Engineer I

    3 weeks ago

    Bengaluru, Karnataka, India lululemon India Tech Hub Full time

    About lululemon:lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...

  • Finance Data Engineer

    1 month ago

    Bengaluru, Karnataka, India 3M Technology Center of Excellence Full time

    Finance Data EngineerFinance Data Engineer will be responsible for implementing data intelligence solutions around Snowflake Data Warehouse for global finance organization.Responsibilities:Analyzes, designs, develops, tests, and supports data analytical solutions withinSnowflake Cloud Data WarehouseDeveloping ETL pipelines in and out of data warehouse using...

  • Technology Manager I

    2 months ago

    Bengaluru, Karnataka, India lululemon India Tech Hub Full time

    About lululemon:lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...

  • Engineering Manager

    3 months ago

    Bengaluru, Karnataka, India lululemon India Tech Hub Full time

    Bachelors degree and/or applicable experience in the information / computer technology field10+ years of experience in information/computer technology.5+ years of experience designing, engineering, implementing large-scale, highly available systems with loosely coupled design patterns.3+ years of experience in digital technologies is required.2+ years...

  • Senior Engineer I

    1 month ago

    Bengaluru, Karnataka, India lululemon India Tech Hub Full time

    About lululemon:lululemon is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well. We owe our success to our innovative products,...

  • Sr Engineer

    3 months ago

    Bengaluru, Karnataka, India Kenvue Full time

    The Data Integration Senior Software Engineer is responsible for leading IICS, SAP Data Services Datasphere & ADF related build & Support projects.Key Responsibilities:Lead the design, implementation, and optimization of automated build, deployment, and release processes for data integration solutions across IICS, SAP Data Services, Datasphere and ADF.Ensure...

  • Senior Software Engineer

    2 months ago

    Bengaluru, Karnataka, India Leading-Biotechnology-Company Full time

    Position Responsibilities:Gather user requirements from manufacturing and engineering teams for new projects and initiativesDevelop reliable and efficient applications to support regional business usersMaintain and enhance the existing digital solutionsCreate and maintain documents for all projectsConduct acceptance test for system enhancements to ensure...

Java Spark Big Data Engineer

3 months ago

Bengaluru, Karnataka, India Cognologix Full time

You will work on:


We help many of our clients make sense of their large investments in data – be it building analytics solutions or machine learning applications.

You will work on cutting edge cloud-native technologies to crunch terabytes of data into meaningful insights.

What you will do (Responsibilities):
Collaborate with product management & engineering to build highly efficient data pipelines for large datasets.

Perform Data quality analysis on disparate data sources and define, implement data quality rulesDesign and develop data models analyzing end to end data requirementsTroubleshooting data loss, data inconsistency, and other data-related issuesProduct development environment delivering stories in a scaled agile delivery methodology.


What you bring (Skills):


2-5 year of experience in hands-on data engineering & medium scale distributed applicationsGood experience in object-oriented programming languages such as Java or ScalaSound experience in RDBMS such as MySQL, Oracle, SQLServer, etc Cloud appliances as Snowflake, Redshift, BigQuery, Azure Synapse etc.

Experience in big data processing technologies such as Hadoop, Spark, Kafka, Databricks, etc.
Experience in Cloud-based services such as Amazon AWS, Microsoft Azure, or Google Cloud PlatformExperience in developing and deploying applications in Linux OSExperience with Scrum and/or other Agile development processesStrong analytical and problem-solving skillsTeam player with self-drive to work independentlyStrong communication and interpersonal skills

Great if you know (Skills):


Some exposure to containerization technologies such as Docker, Kubernetes, or Amazon ECS/EKSSome exposure to NoSQL data stores such as Couchbase, Solr, etc.

Some exposure to Perl, or shell scripting or orchestration tools like AirflowAbility to learn new technologies on his/her own, perform POCs

Advantage Cognologix:
A higher degree of autonomy, startup culture & small teamsOpportunities to become an expert in emerging technologiesRemote working options for the right maturity levelCompetitive salary & family benefitsPerformance based career advancement

About Cognologix:
Cognologix helps companies disrupt by reimagining their business models and innovate like a Startup.

We are at the forefront of digital disruption and take a business-first approach to help meet our client's strategic goals.


We are a Data focused organization helping our clients to deliver their next generation of products in the most efficient, modern, and cloud-native way.