Allstate
Big Data Engineer Senior Consultant I
Role overview
At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.
Job Description
Job Title: Data Engineer
Job Description:
Looking for Data Engineer having 6 to 9 years of total IT work experience.
He/she will be responsible for assisting on building tools and technologies that allow Arity to ingest, normalize, transform, validate and persist trip data at scale in a high performance, reliable and available environment.
Build a state-of-the-art data management platform to execute the data lifecycle management operations within the operational data lake and warehouse and add resiliency in data quality.
Technical Experience Required:
• 3+ years of experience with Spark, Scala/Python and SQL.
• Strong understanding of big data design principles and implementing and managing large data sets along with ETL processing.
• Experience in Test Driven Development including knowledge and experience in testing frameworks.
• Experience with AWS services such as S3, EMR, Step Function, Lambda, SQS.
• Experience with Database such as PostgreSQL.
• Experience with CICD tool such as Jenkins.
• Clear understanding of data management, process automation, system monitoring and maintainability.
• understanding of cloud services, deployment models and distributed systems.
Good to Have:
• Experience with Trino and Starburst.
Job Responsibilities:
• Collaborates with other Engineers, IT Architects and business clients to ensure complete understanding of the platform's technical and business functionality.
• Participates in daily site, cross-site and product team ceremonies associated with scrum principles.
• Designs, develops and tests components of the data ingestion, transformation and delivery functions including full ETL processing.
• Tests, debug and analyzes performance and documents hardware and software technology components.
• Participates in knowledge sharing and contributes to the overall growth of the collective knowledge of the team.
Primary Skills:
• Spark with Scala or Python
• AWS Services (S3, EMR, Step Function, Lambda)
• SQL
• ETL
Primary Skills
Big Data Engineering, Big Data Systems, Big Data Technologies, Data Science, Influencing Others
Shift Time
Recruiter Info
Annapurna Jha
ajhat@allstate.com
About Allstate
Joining our team isn’t just a job — it’s an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. And one where you can impact the future for the greater good.
You’ll do all this in a flexible environment that embraces connection and belonging. And with the recognition of several inclusivity and diversity awards, we’ve proven that Allstate empowers everyone to lead, drive change and give back where they work and live.
Good Hands. Greater Together.
The Allstate Corporation is one of the largest publicly held insurance providers in the United States. Ranked No. 84 in the 2023 Fortune 500 list of the largest United States corporations by total revenue, The Allstate Corporation owns and operates 18 companies in the United States, Canada, Northern Ireland, and India. Allstate India Private Limited, also known as Allstate India, is a subsidiary of The Allstate Corporation. The India talent center was set up in 2012 and operates under the corporation's Good Hands promise. As it innovates operations and technology, Allstate India has evolved beyond its technology functions to be the critical strategic business services arm of the corporation. With offices in Bengaluru and Pune, the company offers expertise to the parent organization’s business areas including technology and innovation, accounting and imaging services, policy administration, transformation solution design and support services, transformation of property liability service design, global operations and integration, and training and transition.
Learn more about Allstate India here.
Keys to Success
At Allstate, it’s all about teamwork, flexibility, and thinking ahead. We all contribute to the bigger picture, combining unique ideas to design innovative, more affordable protection solutions for customers.
We look for candidates with these skills to help us achieve that goal:
Learning agility
Quickly adapt to new situations, continually build new skills, experiment, and embrace new ways of doing things
Customer centricity
Deliver exceptional experience with a customer-first mindset and human-centered design
Digital literacy
Discover and apply emerging digital technology tools, data and insights.
Results-oriented
Start with measurable outcomes and drive results with speed
Inclusive leadership
Integrate diverse viewpoints into decision-making processes to enhance creativity and innovation
Together, we’re all working toward Our Shared Purpose, using our strengths to make a real difference for our people, our customers, our company, and the world around us.
Working in Sales
What We Do:
As an expert on our products and services, you can give customers personalized attention and innovative solutions to make their lives easier.
How We Support You:
Starting day one, you’ll have access to resources and incentives to keep you feeling challenged and excited about your careers.
Make An Impact:
As a member of our sales team, you’ll bring a sense of ease and support to customers looking for a better understanding of their protection options. Whether in the field or talking to customers over the phone, you’ll continue to build trust in who we are and what we do.
Working together
You’re in Good Hands ® is more than a promise we make to our customers. It’s a promise we make our employees, too.
As part of our team, we want you to love where you work, and that starts by giving you the freedom to be yourself. Our workplace flexibility and focus on inclusion creates an environment where you can connect and belong. Our goal is for you to feel trusted, heard and empowered to express yourself. When you thrive, we all thrive. And this year, we’re proud to share that we’ve been recognized by Forbes as one of America’s Best Employers For Diversity, and one of America’s Best Large Employers.
When you join us, you’ll have the opportunity to push your skills to the next level each day. Our dedication to continuous learning ensures that you have access to development programs designed to propel your career forward. As you learn and grow, so do we.
Working here also means getting the chance to do meaningful work and make a real impact in your community. We have been driving change for over 90 years, but the mark we leave on the world, can be even greater when we work together.
Good Hands. Greater Together.
Role overview
At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.
Job Description
Job Title: Data Engineer
Job Description:
Looking for Data Engineer having 6 to 9 years of total IT work experience.
He/she will be responsible for assisting on building tools and technologies that allow Arity to ingest, normalize, transform, validate and persist trip data at scale in a high performance, reliable and available environment.
Build a state-of-the-art data management platform to execute the data lifecycle management operations within the operational data lake and warehouse and add resiliency in data quality.
Technical Experience Required:
• 3+ years of experience with Spark, Scala/Python and SQL.
• Strong understanding of big data design principles and implementing and managing large data sets along with ETL processing.
• Experience in Test Driven Development including knowledge and experience in testing frameworks.
• Experience with AWS services such as S3, EMR, Step Function, Lambda, SQS.
• Experience with Database such as PostgreSQL.
• Experience with CICD tool such as Jenkins.
• Clear understanding of data management, process automation, system monitoring and maintainability.
• understanding of cloud services, deployment models and distributed systems.
Good to Have:
• Experience with Trino and Starburst.
Job Responsibilities:
• Collaborates with other Engineers, IT Architects and business clients to ensure complete understanding of the platform's technical and business functionality.
• Participates in daily site, cross-site and product team ceremonies associated with scrum principles.
• Designs, develops and tests components of the data ingestion, transformation and delivery functions including full ETL processing.
• Tests, debug and analyzes performance and documents hardware and software technology components.
• Participates in knowledge sharing and contributes to the overall growth of the collective knowledge of the team.
Primary Skills:
• Spark with Scala or Python
• AWS Services (S3, EMR, Step Function, Lambda)
• SQL
• ETL
Primary Skills
Big Data Engineering, Big Data Systems, Big Data Technologies, Data Science, Influencing Others
Shift Time
Recruiter Info
Annapurna Jha
ajhat@allstate.com
About Allstate
Joining our team isn’t just a job — it’s an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. And one where you can impact the future for the greater good.
You’ll do all this in a flexible environment that embraces connection and belonging. And with the recognition of several inclusivity and diversity awards, we’ve proven that Allstate empowers everyone to lead, drive change and give back where they work and live.
Good Hands. Greater Together.
The Allstate Corporation is one of the largest publicly held insurance providers in the United States. Ranked No. 84 in the 2023 Fortune 500 list of the largest United States corporations by total revenue, The Allstate Corporation owns and operates 18 companies in the United States, Canada, Northern Ireland, and India. Allstate India Private Limited, also known as Allstate India, is a subsidiary of The Allstate Corporation. The India talent center was set up in 2012 and operates under the corporation's Good Hands promise. As it innovates operations and technology, Allstate India has evolved beyond its technology functions to be the critical strategic business services arm of the corporation. With offices in Bengaluru and Pune, the company offers expertise to the parent organization’s business areas including technology and innovation, accounting and imaging services, policy administration, transformation solution design and support services, transformation of property liability service design, global operations and integration, and training and transition.
Learn more about Allstate India here.
Keys to Success
At Allstate, it’s all about teamwork, flexibility, and thinking ahead. We all contribute to the bigger picture, combining unique ideas to design innovative, more affordable protection solutions for customers.
We look for candidates with these skills to help us achieve that goal:
Learning agility
Quickly adapt to new situations, continually build new skills, experiment, and embrace new ways of doing things
Customer centricity
Deliver exceptional experience with a customer-first mindset and human-centered design
Digital literacy
Discover and apply emerging digital technology tools, data and insights.
Results-oriented
Start with measurable outcomes and drive results with speed
Inclusive leadership
Integrate diverse viewpoints into decision-making processes to enhance creativity and innovation
Together, we’re all working toward Our Shared Purpose, using our strengths to make a real difference for our people, our customers, our company, and the world around us.
Working in Claims
What We Do:
Your ability to quickly and calmly make smart decisions can make a huge difference in how confident customers feel throughout the claims process. And as you support our customers, we’re there to support you.
How We Support You:
We empower your success starting day one. You’ll have access to everything you need to grow professionally while helping our customers get their lives back on track.
Make An Impact:
Helping customers with their claims is about learning their stories, not just processing their paperwork. You can take pride in the fact that you’re providing invaluable guidance and helping to build continued trust in our company.
Working together
You’re in Good Hands ® is more than a promise we make to our customers. It’s a promise we make our employees, too.
As part of our team, we want you to love where you work, and that starts by giving you the freedom to be yourself. Our workplace flexibility and focus on inclusion creates an environment where you can connect and belong. Our goal is for you to feel trusted, heard and empowered to express yourself. When you thrive, we all thrive. And this year, we’re proud to share that we’ve been recognized by Forbes as one of America’s Best Employers For Diversity, and one of America’s Best Large Employers.
When you join us, you’ll have the opportunity to push your skills to the next level each day. Our dedication to continuous learning ensures that you have access to development programs designed to propel your career forward. As you learn and grow, so do we.
Working here also means getting the chance to do meaningful work and make a real impact in your community. We have been driving change for over 90 years, but the mark we leave on the world, can be even greater when we work together.
Good Hands. Greater Together.
Role overview
At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.
Job Description
Job Title: Data Engineer
Job Description:
Looking for Data Engineer having 6 to 9 years of total IT work experience.
He/she will be responsible for assisting on building tools and technologies that allow Arity to ingest, normalize, transform, validate and persist trip data at scale in a high performance, reliable and available environment.
Build a state-of-the-art data management platform to execute the data lifecycle management operations within the operational data lake and warehouse and add resiliency in data quality.
Technical Experience Required:
• 3+ years of experience with Spark, Scala/Python and SQL.
• Strong understanding of big data design principles and implementing and managing large data sets along with ETL processing.
• Experience in Test Driven Development including knowledge and experience in testing frameworks.
• Experience with AWS services such as S3, EMR, Step Function, Lambda, SQS.
• Experience with Database such as PostgreSQL.
• Experience with CICD tool such as Jenkins.
• Clear understanding of data management, process automation, system monitoring and maintainability.
• understanding of cloud services, deployment models and distributed systems.
Good to Have:
• Experience with Trino and Starburst.
Job Responsibilities:
• Collaborates with other Engineers, IT Architects and business clients to ensure complete understanding of the platform's technical and business functionality.
• Participates in daily site, cross-site and product team ceremonies associated with scrum principles.
• Designs, develops and tests components of the data ingestion, transformation and delivery functions including full ETL processing.
• Tests, debug and analyzes performance and documents hardware and software technology components.
• Participates in knowledge sharing and contributes to the overall growth of the collective knowledge of the team.
Primary Skills:
• Spark with Scala or Python
• AWS Services (S3, EMR, Step Function, Lambda)
• SQL
• ETL
Primary Skills
Big Data Engineering, Big Data Systems, Big Data Technologies, Data Science, Influencing Others
Shift Time
Recruiter Info
Annapurna Jha
ajhat@allstate.com
About Allstate
Joining our team isn’t just a job — it’s an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. And one where you can impact the future for the greater good.
You’ll do all this in a flexible environment that embraces connection and belonging. And with the recognition of several inclusivity and diversity awards, we’ve proven that Allstate empowers everyone to lead, drive change and give back where they work and live.
Good Hands. Greater Together.
The Allstate Corporation is one of the largest publicly held insurance providers in the United States. Ranked No. 84 in the 2023 Fortune 500 list of the largest United States corporations by total revenue, The Allstate Corporation owns and operates 18 companies in the United States, Canada, Northern Ireland, and India. Allstate India Private Limited, also known as Allstate India, is a subsidiary of The Allstate Corporation. The India talent center was set up in 2012 and operates under the corporation's Good Hands promise. As it innovates operations and technology, Allstate India has evolved beyond its technology functions to be the critical strategic business services arm of the corporation. With offices in Bengaluru and Pune, the company offers expertise to the parent organization’s business areas including technology and innovation, accounting and imaging services, policy administration, transformation solution design and support services, transformation of property liability service design, global operations and integration, and training and transition.
Learn more about Allstate India here.
Keys to Success
At Allstate, it’s all about teamwork, flexibility, and thinking ahead. We all contribute to the bigger picture, combining unique ideas to design innovative, more affordable protection solutions for customers.
We look for candidates with these skills to help us achieve that goal:
Learning agility
Quickly adapt to new situations, continually build new skills, experiment, and embrace new ways of doing things
Customer centricity
Deliver exceptional experience with a customer-first mindset and human-centered design
Digital literacy
Discover and apply emerging digital technology tools, data and insights.
Results-oriented
Start with measurable outcomes and drive results with speed
Inclusive leadership
Integrate diverse viewpoints into decision-making processes to enhance creativity and innovation
Together, we’re all working toward Our Shared Purpose, using our strengths to make a real difference for our people, our customers, our company, and the world around us.
Working together
You’re in Good Hands ® is more than a promise we make to our customers. It’s a promise we make our employees, too.
As part of our team, we want you to love where you work, and that starts by giving you the freedom to be yourself. Our workplace flexibility and focus on inclusion creates an environment where you can connect and belong. Our goal is for you to feel trusted, heard and empowered to express yourself. When you thrive, we all thrive. And this year, we’re proud to share that we’ve been recognized by Forbes as one of America’s Best Employers For Diversity, and one of America’s Best Large Employers.
When you join us, you’ll have the opportunity to push your skills to the next level each day. Our dedication to continuous learning ensures that you have access to development programs designed to propel your career forward. As you learn and grow, so do we.
Working here also means getting the chance to do meaningful work and make a real impact in your community. We have been driving change for over 90 years, but the mark we leave on the world, can be even greater when we work together.
Good Hands. Greater Together.SM
Benefits
Experience the benefits that make Allstate a great place to work.
*Benefits vary based on position.
Health
- Medical, dental and vision coverage
- HSAs and FSAs
- Wellbeing programs
- Free therapy sessions
Retirement
- 401(k) plan
- Pension plan
- Free financial counseling
Work-life balance
- Paid time off
- Work flexibility
Career development
- Talent shares
- Tuition reimbursement
- Learning opportunities
For a full description of Allstate’s benefits visit our benefits page
Start making a difference
Realize your full potential by doing
work that matters.
Grow your career in meaningful ways.
We want to make sure you have every opportunity to grow, explore new horizons and follow your passion in a meaningful career. It’s an exciting time to join Allstate. Help us shape the future.
Ryan D. / 6 years with Allstate
Sales Market Leader
October 2020 – Present
Anthony N. / 9 years with Allstate
Market Sales Associate Manager
February 2024 – Present
Michael K. / 23 years with Allstate
Property Delivery Director
2023 – Present/Remote
Bree M. / 8 years with Allstate
Unrepresented Bodily Injury Adjuster
December 2022 – Present
Rie T. / 9 years with Allstate
Unrepresented Severe/Complex Adjuster – Casualty 100
2023 – Present
Similar opportunities
Can’t find what you’re looking for?
Let’s stay in touch
If you are interested in being notified of future opportunities at The Allstate Corporation, please click the link below to join our careers community.
Eric G.
Associate counsel, Innovation Law
Our leaders understand that the world is changing fast and people need to adapt and learn new skills. Allstate is committed to helping employees continuously develop and grow.
Kelly
Cloud Engineer
Dana T.
Senior Product Consultant
Paul D.
Software Engineer
I’m proud of building Allstate’s first Bilingual Unlicensed Service team during my first assignment as a leader. It’s an exciting opportunity for our employees and to better serve our Spanish-speaking customers.
Xiomara
Employee Engagement Leader
Joe W.
Commercial Senior Claims Service Adjuster
Brooke T
Property Senior Claims Adjuster
Everyone is encouraged to volunteer and give back however they can throughout the year. I enjoy giving back to the community and supporting the causes that are meaningful to me.
Lisa
Senior Lead Internal Auditor
