We planned an accredited CE activity designed to change performance, but we are thinking about changing course. Can we measure changes in competence instead?

Go back to the first step–did you identify professional practice gaps that showed your learners need education that will lead to changes in their competence, or changes in their performance?  You’ll need to align your activity outcomes with whatever you initially set out to change.  As always, start with outcomes in mind.