Senior Data Engineer

Charlotte, NC
Contracted
Experienced
Senior Data Engineer - Onsite

Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations.
We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications. As we continue to grow, we're looking for a skilled to join our dynamic team and contribute to our mission of transforming business processes through technology.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title: Senior Data Engineer
Job Location: Charlotte, NC.
Job Type: Onsite, Contract on W2
Experience Required: 13+ Years


Job Description:
The Data Engineer with strong hands-on expertise in Databricks and Python to join our insurance industry client in Charlotte, NC. The ideal candidate will have extensive experience designing, developing, and maintaining scalable data engineering solutions using Databricks, Python, and modern cloud-based data platforms. Additionally, the candidate should have exposure to AI Agent configuration, development, and implementation, including integrating AI-powered capabilities into enterprise data workflows.

Candidates with prior experience in the insurance industry, particularly in building data solutions for policy administration, claims processing, underwriting, billing, or customer analytics, will be preferred.

Key Responsibilities
  • Design, develop, and maintain scalable data pipelines using Databricks and Python.
  • Build and optimize ETL/ELT workflows for processing structured and unstructured data.
  • Develop data transformation solutions using PySpark, Spark SQL, and Python.
  • Work with Databricks Lakehouse architecture, Delta Lake, and Unity Catalog.
  • Implement batch and real-time data processing solutions.
  • Develop reusable data engineering frameworks and optimize data processing performance.
  • Integrate data from multiple enterprise systems, APIs, databases, and cloud platforms.
  • Implement data quality checks, validation, monitoring, and error-handling mechanisms.
  • Collaborate with data architects, data scientists, AI engineers, and business stakeholders.
  • Support AI Agent configuration, development, and implementation within enterprise workflows.
  • Integrate AI Agents with enterprise data sources, APIs, and backend services.
  • Assist in implementing Retrieval-Augmented Generation (RAG) workflows and AI-powered data solutions.
  • Follow best practices for data security, governance, scalability, and performance.


Required Skills:

  • Strong hands-on experience with Databricks and its ecosystem.
  • Strong programming experience in Python.
  • Hands-on experience with PySpark, Spark SQL, and Apache Spark.
  • Experience building complex ETL/ELT data pipelines.
  • Strong understanding of data warehousing, data lakes, and Lakehouse architecture.
  • Experience with Delta Lake and Databricks workflows.
  • Experience with SQL and relational databases.
  • Understanding of cloud platforms such as AWS, Azure, or GCP.
  • Exposure to AI Agent configuration, development, and implementation.
  • Understanding of REST APIs and integration with enterprise applications.


Would you like to know more about this opportunity? For immediate consideration, please send your resume directly to [email protected] or contact us via phone at 908-505-3899

At BVTeck, we are committed to providing equal employment opportunities and fostering an inclusive work environment. We encourage applications from all qualified individuals regardless of race, ethnicity, religion, gender identity, sexual orientation, age, disability, or any other protected status. If you require accommodations during the recruitment process, please let us know.
Position offered by "No Fee agency.”

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.

Share

Apply for this position

Required*
We've received your resume. Click here to update it.
Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or Paste resume

Paste your resume here or Attach resume file

Human Check*