Cognitio Analytics Inc | Data Engineer/Senior Data Engineer | gurgaon
2 weeks ago
1 to 8 years - DE/ Sr. DE/ AM /Manager
Must Have:SQLPython/ PysparkAzure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, BitBucket, Version control, Azure DevOpsETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data SecurityAgile Practices, SDLCData Exploration, Data Quality metrics, Historical data Management, Good problem-solving skillExcellent Comm SkillsExp in Data Engineering domain: 2+ Years.Multi years’ experience with Azure-Databricks ecosystem and Py spark.Ability to write clean, concise and organized Py spark code.Ability to break down the project into executable steps, prepare a DFD and execute the samePropose innovative DE solutions to achieve business objectives.Quick on his feet, good at tech and logically complex communicationGood Knowledge of ADF, Docker /containerization.
Good to have:Event HubsAny kind of health care background eg, - PharmaAzure Data Factory, Cosmos DB, Power BI, Azure SynapseCompetitive coding and knows most Py spark syntax by heart.
Job Description:We are seeking a highly skilled Azure Cloud Data Engineer to join our dynamic team. As an Azure Cloud Data Engineer, you will be responsible for designing, implementing, and managing cloud-based data solutions using Microsoft Azure. The ideal candidate should have a strong background in data engineering, with hands-on experience in Azure services and tools.
Essential Job Duties & Responsibilities:Set up workflows and orchestration processes to streamline data pipelines and ensure efficient data movement within the Azure ecosystem.Create and configure compute resources within Databricks, including All-Purpose and SQL Compute and Job Clusters to support data processing and analysis.Set up and manage Azure Data Lake (ADLS) Gen 2 storage accounts and establish a seamless integration with Databricks Workspace for data ingestion and processing.Create and manage Service Principals, key vaults to securely authenticate and authorize access to Azure resources.Utilize ETL (Extract, Transform, Load) techniques to design and implement data warehousing solutions and ensure compliance with data governance policies.Develop highly automated ETL scripts for data processing.Scale infrastructure resources based on workload requirements, optimizing performance and cost-efficiency.Profile new data sources in a different format including CSVs, JSONs etc.Apply problem-solving skills to address complex business and technical challenges, such as data quality issues, performance bottlenecks, and system failures.Demonstrate excellent soft skills and the ability to effectively communicate and collaborate with clients, stakeholders, and cross-functional teams.Implement Continuous Integration/Continuous Deployment (CI/CD) practices to automate the deployment and testing of data pipelines and infrastructure changes.Delivering tangible value very rapidly, collaborating with diverse teams of varying backgrounds and disciplines.Codifying best practices for future reuse in the form of accessible, reusable patterns, templates, and code bases.Manage timely appropriate communication and relationship with clients, partners and other stakeholders.Create and manage periodic reporting of project execution status and other trackers in standard accepted formats.Required Competencies:Strong proficiency in SQL for data manipulation, querying, and optimization.Proficiency in Python and PySpark for data engineering and data processing tasks.Solid understanding of the Microsoft Azure tooling for large-scale data engineering efforts and deployments is highly preferred.Hands-on experience with Azure Databricks, including data ingestion, transformation, and analysis.Ability to set up and manage Azure Data Lake Storage (ADLS) Gen 2 accounts, and familiarity with data lake architecture and best practices.Knowledge of Azure Key Vaults for securely storing and managing cryptographic keys, secrets, and certificates.An ‘engineering’ mindset, willing to make rapid, pragmatic decisions to improve performance, accelerate progress or magnify impact.Comfort with working with distributed teams on code-based deliverables, using version control systems and code reviews.Use of agile and DevOps practices for project and software management including continuous integration and continuous delivery.Ability to conduct data analysis, investigation, and lineage studies to document and enhance data quality and access.Proven track record of scaling infrastructure to meet performance and scalability requirements.Strong analytical and problem-solving skills, with the ability to troubleshoot complex technical issues.Direct experience having built and deployed robust, complex production systems.Proficiency in Event Hubs and Azure Data Factory, particularly in the context of data streaming and transfer.
Qualifications:Bachelor’s degree in computer science, Engineering, or a quantitative discipline.2+ years of professional experience as an Azure Cloud Data Engineer or a similar role.Excellent communication skills, both verbal and written.Strong attention to detail and the ability to work in a fast-paced environment.
-
gurgaon, India Cognitio Analytics Inc Full timeAbout Us:Website: Analytics, founded in 2013, aims to be the preferred provider of AI / ML driven productivity solutions for large enterprises. The company has received awards for its Smart Operations and Total Rewards Analytics Solutions and is dedicated to innovation, R&D, and creating sustained value for clients. Cognitio Analytics has been recognized...
-
gurgaon, India Cognitio Analytics Inc Full timeExperience:1 to 8 years - DE/ Sr. DE/ AM /ManagerMust Have:SQLPython/ PysparkAzure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, BitBucket, Version control, Azure DevOpsETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data SecurityAgile Practices, SDLCData Exploration, Data Quality metrics, Historical data Management, Good...
-
gurgaon, India Cognitio Analytics Inc Full timeExperience:1 to 8 years - DA/ Sr. DA/ AM /ManagerMust Haves:Python/PySparkSQLAdvanced ExcelComm SkillsData Analysis and interpretationProject ManagementStory TellingInterest and ability to get to grips with the underlying business problem and value drivers of a projectGood to have:FlaskTeam ManagementAny kind of health care background eg, -...
-
Senior Data Analytics Lead
2 weeks ago
Gurgaon, Haryana, India Cognitio Analytics Full timeJob DescriptionCognitio Analytics is seeking a Senior Data Analytics Lead to oversee our data analytics team and be the technical head of a global workforce.The objective of this role is to ensure timely, robust, and accurate research, conception, delivery, and ongoing monitoring of analytical products and frameworks. Effective communication between key...
-
gurgaon, India Cognitio Analytics Inc Full timeExperience:1 to 8 years - DA/ Sr. DA/ AM /ManagerMust Haves:Python/PySparkSQLAdvanced ExcelComm SkillsData Analysis and interpretationProject ManagementStory TellingInterest and ability to get to grips with the underlying business problem and value drivers of a projectGood to have:FlaskTeam ManagementAny kind of health care background eg, -...
-
Gurgaon, Haryana, India Cognitio Analytics Inc Full timeOverview of the RoleCognitio Analytics Inc seeks a highly skilled Data Transformation and Leadership Specialist to oversee our data analytics team and serve as the technical head of a global workforce. This role is responsible for ensuring timely, robust, and accurate research, conception, delivery, and ongoing monitoring of analytical products and...
-
Chief Data Engineering Architect
2 weeks ago
Gurgaon, Haryana, India Cognitio Analytics Inc Full timeWe are seeking a highly skilled Azure Cloud Data Engineer to join our dynamic team at Cognitio Analytics Inc. As an Azure Cloud Data Engineer, you will be responsible for designing, implementing, and managing cloud-based data solutions using Microsoft Azure.Key Responsibilities:Data Pipeline ManagementSet up workflows and orchestration processes to...
-
Data Transformation and Leadership Expert
17 hours ago
Gurgaon, Haryana, India Cognitio Analytics Inc Full timeCognitio Analytics Inc is seeking an experienced Data Analyst to Manager for a key leadership role.As a Data Transformation and Leadership Expert, you will oversee the data analytics team and serve as the technical head of a global workforce across a multi-country team.The primary objective of this role is to ensure timely, robust, and accurate research,...
-
Cloud Data Engineer
3 hours ago
Gurgaon, Haryana, India Cognitio Analytics Inc Full timeJob SummaryCognitio Analytics Inc is seeking an experienced Cloud Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing scalable cloud-based data solutions using Microsoft Azure.About the RoleWe are looking for a highly skilled professional with expertise in Azure services and...
-
Chief Architect and Technical Lead
5 days ago
Gurgaon, Haryana, India Cognitio Analytics Inc Full timeCognitio Analytics Inc is a leading provider of AI/ML driven productivity solutions for large enterprises. With a strong focus on innovation, R&D, and client satisfaction, the company has received awards for its Smart Operations and Total Rewards Analytics Solutions.About UsFounded in 2013, Cognitio Analytics aims to be the preferred provider of AI/ML driven...
-
Chief Technology Strategist
5 days ago
Gurgaon, Haryana, India Cognitio Analytics Inc Full timeAbout Cognitio Analytics IncCognitio Analytics, a leading provider of innovative AI/ML driven productivity solutions, is seeking a highly experienced and driven leader to join its fast-growing healthcare-based product. This senior leadership position requires strong technical expertise, excellent managerial skills, and the ability to oversee and manage the...
-
Azure Cloud Data Engineering Specialist
18 hours ago
Gurgaon, Haryana, India Cognitio Analytics Full timeJob Title: Azure Cloud Data Engineering SpecialistAt Cognitio Analytics, we are seeking a highly skilled Azure Cloud Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and hands-on experience in Azure services and tools.The Azure Cloud Data Engineer will be responsible for designing, implementing,...
-
Data engineer/senior data engineer
1 week ago
Gurgaon, India Cognitio Analytics Inc Full timeExperience: 1 to 8 years - DE/ Sr. DE/ AM /Manager Must Have: SQL Python/ Pyspark Azure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, Bit Bucket, Version control, Azure Dev Ops ETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data Security Agile Practices, SDLC Data Exploration, Data Quality metrics,...
-
Data engineer/senior data engineer
2 weeks ago
Gurgaon, India Cognitio Analytics Inc Full timeExperience:1 to 8 years - DE/ Sr. DE/ AM /ManagerMust Have:SQLPython/ PysparkAzure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, Bit Bucket, Version control, Azure Dev OpsETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data SecurityAgile Practices, SDLCData Exploration, Data Quality metrics, Historical data Management, Good...
-
Director technology
4 days ago
Gurgaon, India Cognitio Analytics Inc Full timeAbout Us:Website: Analytics, founded in 2013, aims to be the preferred provider of AI / ML driven productivity solutions for large enterprises. The company has received awards for its Smart Operations and Total Rewards Analytics Solutions and is dedicated to innovation, R&D, and creating sustained value for clients. Cognitio Analytics has been recognized...
-
Director Technology
5 days ago
Gurgaon, India Cognitio Analytics Inc Full timeAbout Us:Website: Analytics, founded in 2013, aims to be the preferred provider of AI / ML driven productivity solutions for large enterprises. The company has received awards for its Smart Operations and Total Rewards Analytics Solutions and is dedicated to innovation, R&D, and creating sustained value for clients. Cognitio Analytics has been recognized...
-
Director Technology
5 days ago
Gurgaon, India Cognitio Analytics Inc Full timeAbout Us: Website: Cognitio Analytics, founded in 2013, aims to be the preferred provider of AI / ML driven productivity solutions for large enterprises. The company has received awards for its Smart Operations and Total Rewards Analytics Solutions and is dedicated to innovation, R&D, and creating sustained value for clients. Cognitio Analytics...
-
▷ High Salary: Director Technology
5 days ago
Gurgaon, India Cognitio Analytics Inc Full timeAbout Us:Website: Analytics, founded in 2013, aims to be the preferred provider of AI / ML driven productivity solutions for large enterprises. The company has received awards for its Smart Operations and Total Rewards Analytics Solutions and is dedicated to innovation, R&D, and creating sustained value for clients. Cognitio Analytics has been recognized as...
-
Technical Director for Cloud Solutions
1 day ago
Gurgaon, Haryana, India Cognitio Analytics Inc Full timeCognitio Analytics Inc is a pioneering provider of AI / ML driven productivity solutions for large enterprises.We are committed to innovation, R&D, and creating sustained value for clients.Our solutions include Total Rewards Analytics powered by Cognitio's Total Rewards Data Factory.We drive productivity in complex operations, such as claims processing,...
-
Gurgaon, India Cognitio Analytics Inc Full timeExperience:1 to 8 years - DE/ Sr. DE/ AM /ManagerMust Have:- SQL- Python/ Pyspark- Azure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, BitBucket, Version control, Azure DevOps- ETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data Security- Agile Practices, SDLC- Data Exploration, Data Quality metrics, Historical data...
