Tag Archives: assessment

Supplier Quality Audits: A Critical Factor in Ensuring GMP Compliance

By Amy Scanlin
No Comments

Editor’s Note: This is an article submission from the EAS Consulting Group, LLC team.


To Audit, or not to audit? Not even a question! Audits play a crucial role in verifying and validating business practices, ensuring suppliers are meeting their requirements for Good Manufacturing Practices (GMPs), and most importantly, protecting your interests by ensuring that you consistently receive a compliant and quality product. Audits can help ensure sound business procedures and quality systems, including well-established SOPs, verification and documentation of batch records, appropriate sanitation practices and safe storage and use of ingredients. Audits can also identify deficiencies, putting into motion a corrective action plan to mitigate any further challenges. While a detailed audit scheme is commonplace for established industries such as food, pharmaceuticals and dietary supplements, it is equally important for the cannabis industry to ensure the same quality and safety measures are applied to this budding industry.

If the question then is not whether to audit, perhaps the question is how and when to audit, particularly in the case of a company’s suppliers.This is an opportunity to strengthen the working relationship with each side demonstrating a commitment to the end product.

Supplier audits ensure first and foremost that the company with which you have chosen to work is operating in a manner that meets or exceeds your quality expectations – and you should have expectations because ultimately your product is your responsibility. Any issues that arise, even if they are technically the fault of a supplier, become your issue, meaning any enforcement action taken by your state regulators will directly impact your business. Yes, your supplier may provide you with a batch Certificate of Analysis but you should certify their results as well.

Audits are a snapshot of a moment in time and therefore should be conducted on a regular basis, perhaps biennially or even annually, if they are a critical supplier. In some cases, companies choose to bring in third-party auditors to provide an objective assessment of suppliers. This is especially helpful when the manufacturer or customer does not have the manufacturing, compliance and analytical background to accurately interpret data gathered as part of the audit. With the responsibility for ensuring ingredient identity and product integrity falling on the manufacturer, gaining an unbiased and accurate assessment is imperative to reducing the risk to your business.

Conducting a supplier audit should be well planned in advance to ensure both sides are ready. The audit team must be prepared and able to perform their duties via a combination of education, training and experience. A lead auditor will oversee the team and ultimately will also oversee the results, verifying all nonconformities have been properly identified. They will also work with the supplier to conduct a root cause analysis for those nonconformities and develop a corrective action plan to eliminate them from occurring in the future. The audit lead will also verify follow-up results.

Auditors should discuss with the supplier in advance what areas will be observed, what documentation will need to be ready for review and they should conduct their assessments with professionalism. After all, this is an opportunity to strengthen the working relationship with each side demonstrating a commitment to the end product.This is your chance to ensure your suppliers are performing and will meet your business, quality and product expectations.

Auditors must document that ingredient identity and finished product specifications are verified by test methods appropriate for the intended purpose (such as a whole compound versus a powder). State regulations vary so be certain to understand the number and types of required tests. Once the audit is complete and results are analyzed, you, the manufacturer, have an opportunity to determine if the results are acceptable. Remember, it is your product, so ultimately it is your responsibility to review the available data and release the product to market, you cannot put that responsibility on your supplier.

Quality Agreements as Part of a Business Agreement

There are opportunities to strengthen a partnership at every turn, and one way to set a relationship on the right path is to include a quality agreement as part of a business agreement. A quality agreement lays out your expectations for your suppliers, what you are responsible for and is a living document that, once signed, demonstrates their commitment to upholding the standards you expect. Just as with a business agreement, have any quality agreements reviewed by an outside expert to ensure the wording is sound and that your interests are protected. This is just another step in the development of a well-executed business plan and one that solidifies expectations and provides consequences when those expectations are not met.

Supplier audits must be taken seriously as they are opportunities to protect your brand, your business and your consumers. Enter into an audit as you would with any business endeavor – prepared. This is your chance to ensure your suppliers are performing and will meet your business, quality and product expectations.

EVIO Logo

EVIO Labs: The First Accredited Cannabis Lab in Florida

By Lauren Masko
No Comments
EVIO Logo

EVIO Labs recently became the first cannabis laboratory in Florida to obtain ISO 17025 accreditation. Perry Johnson Laboratory Accreditation, Inc. (PJLA), an organization that provides third-party assessments to ISO/IEC 17025, accredited EVIO Labs. The assessment process that lead to ISO 17025 accreditation for EVIO Labs included a thorough review of their quality management system, their capability to perform potency and contaminant testing for cannabis products.

Tracy Szerszen, president and operations manager at PJLA, encourages this international standard for laboratories to provide confidence to end-users that the test results they receive are reliable. She says laboratories that achieve this accreditation are showing they have the proper tools, equipment and staff to provide accurate testing. “It is a very critical component of the industry, and becoming accredited provides the assurance that laboratories are performing to the highest standard,” says Szerszen. “EVIO Labs has taken the right step in their commitment towards meeting this standard and providing clean and safe cannabis for the patients of Florida.”

PJLAEVIO Labs provides cannabis testing for cannabinoid and terpene profiles, microbiological and pesticides contamination, residual solvent, heavy metals, mycotoxins, water activity and moisture content. Chris Martinez, co-founder and president of EVIO Labs Florida explains that the Florida Department of Health mandates that an independent third-party laboratory tests medical cannabis to ensure that these products are safe for human consumption. Martinez says their first priority is the safety of their patients, and ensuring that EVIO Labs provides clean and safe cannabis for Florida.

Chris Martinez
Chris Martinez, co-founder and president of EVIO Labs Florida

Martinez launched their laboratory with some help from Shimadzu last year. “Our Broward lab is powered by Shimadzu with over $1.2M in the latest testing equipment utilizing LCMS technology with the world’s fastest polarity switching time of 5 m/sec and scan speeds of 30,000 u/sec with UF Qarray sensitivity 90 times that of previously available technologies,” says Martinez. According to Martinez, their licensing agreement with EVIO Labs (OTC:SGBYD) marked a first for the publicly traded company with exclusivity in the Florida market. The agreement includes proprietary testing methodologies, operating procedures, training and support.

Every certificate of analysis is reviewed by a lab director with over 20 years of experience operating in FDA regulated labs. Martinez says that EVIO has some of the most advanced technology in the industry, which provides them the opportunity to quickly provide results, frequently as fast as a 24-hour period. Martinez and his team are currently building a 3,300 square-foot laboratory in Gainesville, which is expected to be running by March of this year.

Designing Your Continuing Cannabis Education Program

By RJ Starr
No Comments

As many states’ medical cannabis programs are already in full swing and several are launching or nearing their one-year or biennial maturation periods, medical cannabis dispensaries and cannabis cultivation and processing facilities should be fine-tuning their Continuing Cannabis Education Program, or CCEP, and be ready for inspection by state agencies.

While states with medical cannabis programs administer them through various agencies such as Department of Medicine/Health, Department of Pharmacy, Department of Commerce, Alcoholic Beverage Control, each has their own minimum requirements for continuing education in the medical cannabis space, and each structures their program in the direction within which that particular regulatory agency leans. Each state’s personality also brings an influential component as well; for example, a state with a highly visible opioid crisis may place greater emphasis on substance abuse training.

Suffice it to say that while there is certainly insight to be gained from knowing your particular state, there are certain elements of an ongoing professional development program that should be considered in each CCEP. This article will explore a few of the elements integral to any successful human capital and professional development plan from a vantage of compliance, and will offer some insight into the exceptional training methodology designed by Midwest Compassion Center and Bloom Medicinals.

There are a number of key considerations in developing a Continuing Cannabis Education Program, and a thoughtful CCEP should be developed specifically to meet the needs of both the organization and its employees. This can be done by a needs assessment consisting of three levels: organizational, occupational, and individual assessments.

  1. Needs assessment and learning objectives. This part of the framework development asks you to consider what kind of training is needed in your organization. Once you have determined the training needed, you can set learning objectives to measure at the end of the training.
    1. Organizational assessment. In this type of needs assessment, we can determine the skills, knowledge and abilities our cannabis dispensaries need in order to meet their strategic objectives. This type of assessment considers things such as changing laws, demographics and technology trends. Overall, this type of assessment looks at how the organization as a whole can handle its weaknesses while promoting strengths.
    2. Occupational (task) assessment. This type of assessment looks at the specific tasks, skills, knowledge and abilities required of our employees to do the jobs necessary within our dispensaries.
    3. Individual assessment. An individual assessment looks at the performance of an individual employee and determines what training should be accomplished for that individual.
  2. Consideration of learning styles. Making sure to teach to a variety of learning styles is important to development of training programs.
  3. Delivery mode. What is the best way to get your message across? Is classroom or web-based training more appropriate, or should one-on-one mentoring be used? Successful training programs should incorporate a variety of delivery methods.
  4. How much money do you have to spend on this training? This does not only include the cost of materials, but the cost of time. Consideration should also be given to the costs associated with not investing in training: CFO asks CEO, “What happens if we invest in developing our people and then they leave us?” CEO: “What happens if we don’t, and they stay?”
  5. Delivery style. Will the training be self-paced or instructor led? What kinds of discussions and interactions can be developed in conjunction with this training? The delivery style must take into account people’s individual learning styles. A balance of lectures, discussions, role-playing, and activities that solidify concepts are considered part of delivery style.
  6. Audience. Who will be part of this training? Do you have a mix of roles, such as accounting people and marketing people? What are the job responsibilities of these individuals, and how can you make the training relevant to their individual jobs? The audience for the training is an important aspect when developing your CCEP. This can allow the training to be better developed to meet the needs and the skills of a particular group of people.
  7. Content. What needs to be taught? How will you sequence the information? The content obviously is an important consideration. Learning objectives and goals for the training should be established and articulated before content is developed.
  8. Timelines. How long will it take to develop the training? Is there a deadline for training to be completed, and if so, what risk analysis can be used to determine the consequences of not meeting that deadline? After content is developed, understanding time constraints is an important aspect. Will the training take one hour or a day to deliver? What is the timeline consideration in terms of when people should take the training?
  9. Communication. How will employees know the training is available to them? Letting people know when and where the training will take place is part of communication.
  10. Measuring effectiveness. How will you know if your training worked? What ways will you use to measure this? The final aspect of developing a training framework is to consider how it will be measured. At the end, how will you know if the trainees learned what they needed to learn?

A thorough review of your state’s rules and regulations should take place quarterly, with one or more specific employees designated to stay abreast of changes. If your regulatory authority has implemented requirements that trainings must be approved in advance, know that as well, and keep your Continuous Cannabis Education Program up-to-date and ready for inspection.

Ask The Expert: Exploring Cannabis Laboratory Accreditation Part 3

By Aaron G. Biros
No Comments

In the first part of this series, we spoke with Michelle Bradac, senior accreditation officer at A2LA, to learn the basics of cannabis laboratory accreditation. In the second part, we sat down with Roger Brauninger, A2LA Biosafety Program manager, to learn why states are looking to lab accreditation in their regulations for the cannabis industry.

In the third part of this series, we sit down with Michael DeGregorio, chief executive officer of Konocti Analytics, Inc., to talk method development in the cannabis testing industry and his experience with getting accredited. In the final part of this series, we are going to sit down with Susan Audino, an instructor at A2LA to learn more about the requirements where she’ll offer some advice for labs seeking accreditation.

Michael DeGregorio, chief executive officer of Konocti Analytics, Inc.

Michael DeGregorio is a doctor of pharmacy with an extensive career in medicine and scientific research. He’s worked in cancer research and medicine, teaching at the University of California, San Francisco, Yale University School of Medicine, University of Texas, Health Science Center at San Antonio and University of California, Davis. Before becoming the CEO of Konocti Analytics, a laboratory based in California, DeGregorio was also a published author in a large number of peer-reviewed medical journals.

In this piece, we sit down with DeGregorio to find out what challenges labs face when getting accredited, why they sought accreditation and their experience with getting off the ground. Stay tuned for the final part of this series!

CannabisIndustryJournal: How does a laboratory go about choosing an appropriate method in an industry where, generally, there are no validated methods available?

Michael DeGregorio: Our approach to developing analytical methods for testing cannabis began with a review of the existing laboratories and their methods, where we found no standardization and inconsistent results. Since cannabis is being used by the public and as a medicine, our goal is to help make it as contaminant-free as possible for the well-being of the consumer, and this begins by developing a state-of-the-art analytical facility.

When developing new methods, we review the published literature to see what has already been done and try to arrive at a scientifically sound consensus. We then perform experiments to determine which set of conditions works best for us. Once we have developed an appropriate method, we validate it pursuant to ISO/IEC 17025 requirements.

CIJ: How do you go about choosing what type of equipment to use for testing (e.g. by limit of detection, acceptable method use of equipment for other industries, etc.)?

Michael: After reviewing the operations of other testing laboratories, we concluded that, in general, they were not taking advantage of the most advanced technologies and had limited personnel qualified to operate it. Because public safety is our main concern, we chose state-of-the-art equipment, including GC/LC-MS with Orbitrap and ICP-MS, for testing medicinal cannabis. In addition to identifying unknown pesticides, we needed the capability of performing full chemical screening of all samples for potentially harmful compounds, e.g. steroids, present in cannabis, as well as the ability to detect trace levels of metals.

Our greatest concern is the fact that pesticides in cannabis have not been adequately studied. Current pesticide regulations suggest that government authorities believe that there are a finite number of pesticides available. Smart farmers could easily avoid the pesticides on current lists. Because of this, we chose to validate our pesticide methods with a focus on chemical classes, as opposed to specific pesticides, to give us the broadest possible coverage of potential compounds. The Orbitrap mass spectrometers also allow us to detect and identify unknown pesticides. This is something not currently being done by other laboratories. The latest microbiology methods for cannabis testing include DNA analysis, and for this we use qRT-PCR technology. Finally, the high sensitivity of ICP-MS allows for the detection of metals concentrations that may be harmful, yet undetectable by other means.

CIJ: What do you feel are the benefits of being accredited?

Michael: Being accredited shows the public that we have made a commitment to quality analytics. We feel this gives our clients peace of mind when marketing their products, knowing that they have been tested by a laboratory meeting the highest international standards of operation available using the latest technology. Furthermore, being accredited requires participation in ongoing proficiency testing programs, which helps maintain analytical competency. It should be pointed out that any prospective client of an analytical facility should take into account the laboratory’s full accredited scope of testing to ensure its competency.

CIJ: What challenges did you face during the process of getting your laboratory started and/or during the accreditation process?

Michael: Developing the quality management system and getting our equipment and processes to a state where they met accreditation requirements took several months of hard work, and turned out to be a bit more daunting than we anticipated. Our pre-accreditation assessment revealed that much work remained to be done, and it gave us a real appreciation for the level of detail and documentation required. We remained determined and eventually achieved our accreditation.

CIJ: What are the benefits to the grower and dispensaries to choosing an accredited laboratory for the testing of their product?

Michael: By choosing an accredited laboratory with a full scope of testing (potency, pesticides, mycotoxins, metals, microbiology, residual solvents and terpenes), growers and dispensaries can rest assured that their products have been tested using validated methods with appropriate quality control by trained, competent personnel. For growers, this makes their products more attractive to potential buyers. For dispensaries, this means they can confidently market their products with the knowledge that the information shown on the label is accurate, which in turn gives their customers peace of mind that the product they are consuming does not contain unacceptable levels of contaminants. 

CIJ: Why did you choose A2LA?

Michael: Once we decided to pursue accreditation, we researched the various accrediting bodies available as well as their reputations. We discovered that while all accrediting bodies are themselves accredited to the same standard, accreditation by the various bodies was not considered equal in practice. In our opinion, A2LA was considered the most prestigious, highly regarded accrediting body. Furthermore, some of the most prestigious laboratories in the country are accredited by A2LA, including Los Alamos National Laboratory, the Food and Drug Administration’s Center for Biologics Evaluation and Research, Lawrence Livermore National Laboratory, Centers for Disease Control, Federal Bureau of Investigation and the United States Department of Agriculture. Many of our preferred sources of scientific supplies and services are accredited by A2LA as well. As our goal was to be accredited by the best available accrediting body, we chose A2LA.

Human Resources and the Cannabis Workforce

By Aaron G. Biros
1 Comment

Cannabis businesses encounter a variety of problems when hiring and managing employees. Some of those are issues that every business runs into and some of them are quite specific to the cannabis industry. Chris Cassese, co-founder and managing director of Faces Human Capital Management, has some solutions for cannabis businesses facing seemingly daunting workforce management issues.

Cassese co-founded Faces HCM with Caela Bintner after two decades of working in the human resources and sales strategy across a variety of financial institutions. He oversees software platform development, daily operations, sales, and business development for their organization. Before co-founding the company, Cassese held a variety of operational and product development roles during his ten-year tenure at Merrill Lynch, worked in marketing at HSBC and was a sales and performance advisor at Insperity, a professional employment organization. Faces HCM is a professional employment organization that handles workforce compliance, education, and other HR needs for cannabis companies. They work with companies like Dixie Elixirs, LivWell and Women Grow, among other cannabis businesses.

Chris Cassese, co-founder and managing director of Faces Human Capital Management

According to Cassese, the cannabis industry faces a roughly 60% turnover rate, which is on par with the turnover rates in retail and call centers. Those are industries that typically have high turnover rates simply because the nature of the business. However, Cassese says it doesn’t have to be so high for the cannabis industry. “It is easy to say it is just high turnover by nature, but we found there are some steps that we can put in place that seem relatively easy, but are key tenants of Fortune 500 companies’ hiring strategies,” says Cassese. “Engaging in a needs-based analysis with companies will help us figure out exactly what’s going on.” They start by looking at the onboarding process, or what happens immediately after an employee is hired. “We start by looking at their pay rate, employee handbook and the paid time off policy, which are some of the points that a lot of the owners are familiar with coming from other high-end industries outside of cannabis.” He says things like swag bags, free ski passes after reaching quotas and other perks can keep employees engaged on the team. “Things like that go a long way and can reduce turnover by up to 20 or 30 percent,” says Cassese. “Sometimes [business owners] are so stressed with regulatory compliance that they don’t have time to tackle these issues so employee dissatisfaction often starts with onboarding procedures.” That can include anything from analyzing the overall compensation structure to making a video displaying the company’s vision, mission and values. “There is no panacea for reducing turnover. It requires conducting a needs-based assessment, taking pieces of what we know works well in other companies and bringing that to the cannabis industry.” Making an employee feel like they are part of the team can help boost retention and keep turnover low.

One area they often help companies with is performance reviews. “Performance reviews are a big part of any business,” says Cassese. “You can’t make progress if you don’t know where you’re going. If you don’t know how you’re doing you can’t get better.” Looking at the supervisor level, they have often found employees have never given a performance review before. “We implement processes to teach them how to deliver positive or negative performance reviews and help make them feel comfortable delivering that,” says Cassese. They might have employees perform a DISC analysis (dominance, influence, steadiness and conscientiousness), a personality test akin to the Meyers-Briggs test. “From this we can help figure out the stressors and motivators of people and create effective teams,” says Cassese. “If an employee might be more outgoing or humble, high-spirited, results-oriented, analytical or good working on teams.” These are approaches to workforce management that have been adopted from Fortune 500 companies.

Caela Bintner, Co-Founder and Managing Director of Faces Human Capital Management

Cassese says one of the most overlooked items for companies are proper I-9 verification forms. This goes back to basic record keeping and documentation, but if overlooked, companies can get hefty fines for improper record keeping. “You are supposed to have a separate binder, in a separate locked drawer where your I-9 forms are housed, but a lot of people don’t know about that, which could come back to bite them in the form of large fines” says Cassese. “Businesses can’t afford to have sloppy record keeping. We help businesses take a look at their process and how they put their files in the cloud or physical locations, which is an area where companies often need guidance.” Civil fines can reach up to $20,000 for mistakes on I-9 forms.

Employee education is another crucial aspect of managing the workforce. Faces HCM has a learning management system that gives companies the ability to push education to their employees. Education is of course a broad term and can cover a wide variety of needs for employees. “We can help them take leadership, teamwork, excel, OSHA, safety classes and more,” says Cassese. “Training that shows you active listening, empathy skills and other types of training can really help budtenders deal with customers appropriately.” They have developed customized training programs for cannabis companies expanding beyond their own state too. “As you find certain cannabis companies growing in different states they want to create a repeatable, consistent and predictable experience,” says Cassese. “Putting those standard operating procedures online is important to streamline the process and ensures that you are creating a learning or education plan to meet your employees’ needs.” That can look like requiring employees to take an online course once every quarter, or offering them books on subjects pertaining to their specific job function.

Little things like improving the employee experience, implementing an education program and keeping up with employee records can make or break a business. They all add up to solid workforce management, which if done correctly, can enhance a business’ bottom line and keep employees working for you.

Oregon Cannabis Lab Accreditation Program Gets Help, Problems Addressed

By Aaron G. Biros
No Comments

Last week, news of problems facing Oregon’s cannabis laboratory accreditation program surfaced, leading some to speculate about possible delays for the recreational cannabis market. According to The Register-Guard, ORELAP administrator Gary Ward believed the program was “on the precipice of collapse.”

oha_logo_lrgAccording to Jonathan Modie, spokesman for the Oregon Health Authority (OHA), the Oregon Environmental Laboratory Accreditation Program (ORELAP) was anticipating over 30 cannabis laboratories applying for accreditation and they doubled their staff from two to four to prepare for the uptick in applications.

In June, the agency had zero labs applying for accreditation but within two months, 37 labs applied. However, the Oregon Department of Environmental Quality (DEQ) just provided three additional staff members on Monday to help with the application process, says Modie.

Some believe the issues could mean the state may not have enough accredited labs by October 1st, when the recreational cannabis market is expected to go into full swing. “It is difficult to say exactly how many labs we can accredit by October 1,” says Modie. “We have seven labs today which would bring it to nine labs waiting for assessment, but our goal is to get as many labs assessed and hopefully accredited as soon as possible.”

With the additional staff members, Modie is hopeful this will jumpstart the program. “We really appreciate our collaboration with the DEQ and look forward to boosting our capacity a bit to help us get through this busy time,” says Modie.

Part of the reason some laboratories might have trouble meeting prerequisites is simply because the requirements are very strict. “The process involves submitting a quality manual, standard operating procedures, method validation, submitting proficiency testing data and finally undergoing an ORELAP assessment by our staff, so it is a very rigorous process,” says Modie. “This speaks to our concern for making sure they have the right systems in place so public health is protected.” Modie said there were at least three labs that did not pass the assessment.

Roger Voelker
Roger Voelker, lab director at OG Analytical

Bethany Sherman, chief executive officer of OG Analytical, believes the hardest part of the process involves getting accredited for testing pesticides. OG Analytical, based in Eugene, Oregon, has already received their accreditation, one of the first to do so. “The pesticide testing requires our most expensive instrumentation and the sample preparation for testing pesticides is the most time consuming,” says Sherman. “Not only does it require very specific instrumentation, it also requires a real know-how and expertise to ensure we are cleaning samples appropriately, minimizing background noise and looking at the pesticides in trace quantities.” According to Sherman, laboratories are also left to their own devices to develop methodologies specifically for the cannabis matrix, adding to the difficulties.

Rodger Voelker, Ph.D., lab director at OG Analytical, seems confident that the state will be able to handle it. “It is a relief they were able to get some resources from the DEQ and I think the state will not allow a program with this kind of importance to fall apart,” says Voelker. He believes after this initial phase of putting the program in place, the workload will go down. “It is easier to maintain a program than it is to implement,“ adds Voelker. In his eyes, it is crucial for the program to require rigorous science. “People are forced to reconcile that there is a tremendous amount of controls to be considered to produce legally defensible data and I think it is great that the requirements are so strict.”

The OHA’s job is to essentially safeguard public health and they do not want to leave any stone unturned when it comes to potential contamination, says Modie. “This is not just about getting as many labs accredited as possible, this is about protecting public health.”