Associate Data Engineer

Job Purpose  

The Associate Data Engineer will play a critical role in ensuring massive reservoirs of big data availability, seamless integration and deployment of Machine Learning, Artificial Intelligence, and Generative AI applications on the Azure platform.  

This position will collaborate closely with Data Engineers, Data Warehouse Developers, Data Scientists, Cloud Engineers, Enterprise Architects, Security, and Network Engineers to design and implement robust CI/CD processes using Assurant's Azure DevOps and GitHub Enterprise infrastructure.
 

Primary Job Accountabilities and Responsibilities  

• Perform hands-on programming work with Microsoft technology stack, including .NET Core, Microservices, Web API, C#, ASP.NET, ADO.NET, MVC, Entity Framework, SQL Server and Python.  

• Participate in continuous integration and continuous delivery (CI/CD) pipeline development and maintenance using Azure DevOps and GitHub using   

• May also implement infrastructure as code (IaC) practices using Terraform and Azure Resource Manager (ARM) templates to provision and manage Azure resources 

• Troubleshoot and resolve errors in production systems, logging detailed information and providing customer updates 

• Assist other engineers in product development, optimization, and process improvement efforts 

• Coordinate data-related activities and manage customer expectations during system maintenance 

• Assist with data reconciliation to ensure high-quality data for reporting, analytics, ML, and AI solutions 

• Monitor production solutions to ensure compliance with established SLA metrics and data quality standards 

• Participate in all Agile ceremonies and stand-ups 

• Contribute to research and proof of concept development as guided by Senior and Lead Engineers 

• Create comprehensive documentation and track technical issues 

• Communicate effectively with cross-functional teams and customers 

• Stay updated with the latest industry trends and technologies to propose and implement improvements 

Basic Qualifications Required  

Education  

• Bachelor's degree with 3+ years of experience in engineering, science, or computer science 

• Alternatively, a Master's degree with 2+ years of experience 

Technical Skills and Experience  

• Proficiency in at least one cloud platform (Microsoft Azure, AWS, or Google Cloud Platform) 

• Experience with containerization concepts and tools (Docker and Kubernetes) 

• Proficiency in scripting languages such as PowerShell, Bash, or Azure CLI 

• Knowledge of agile methodologies (Scrum or Kanban) 

• Understanding of security best practices and compliance frameworks (e.g., GDPR) 

• Experience with Cloud Service Models: PaaS, IaaS, SaaS 

• Minimum 3 years of development experience using Microsoft technology stack 

• Strong problem-solving and troubleshooting abilities 

• Excellent collaboration and communication skills 

Preferred Experience, Skills, and Knowledge  

• Knowledge of foundational concepts in:  

• Business Intelligence 

• Data Warehousing 

• Machine Learning 

• Artificial Intelligence 

• Large Language Models 

• Experience with:  

• SQL, Python 

• Linux Shell Scripting, Microsoft PowerShell 

• Spark, PySpark 

• NoSQL 

• Proficiency in creating interactive web applications and single-page applications 

• Experience writing unit test cases for business logic, repositories, and controllers 

• Vendor-based cloud certifications in Azure or DevOps (e.g., Microsoft Certified: Azure Fundamentals, Microsoft Certified: Azure DevOps Engineer Expert)