lib-python/3/test/test_typing.py::unmodified

== PyPy 3.12.13 (a3c6b428e7a8, Jul 09 2026, 03:54:00) [PyPy 8.0.0-alpha0 with GCC Apple LLVM 16.0.0 (clang-1600.0.26.6)]
== macOS-15.7.7-arm64-arm-64bit little-endian
== Python build: release with_assert
== cwd: /private/tmp/buildbot-arm64/pytest/test_python_worker_59763æ
== CPU count: 8
== encodings: locale=UTF-8 FS=utf-8
== resources (3): curses,gui,network

Using random seed: 2460390319
Raised RLIMIT_NOFILE: 256 -> 1024
0:00:00 load avg: 2.36 Run 1 test sequentially in a single process
0:00:00 load avg: 2.36 [1/1] test_typing
test_all (test.test_typing.AllTests.test_all) ... ok
test_all_exported_names (test.test_typing.AllTests.test_all_exported_names) ... ok
test_annotated_cached_with_types (test.test_typing.AnnotatedTests.test_annotated_cached_with_types) ... ok
test_annotated_in_other_types (test.test_typing.AnnotatedTests.test_annotated_in_other_types) ... ok
test_annotated_mro (test.test_typing.AnnotatedTests.test_annotated_mro) ... ok
test_attr_passthrough (test.test_typing.AnnotatedTests.test_attr_passthrough) ... ok
test_cannot_check_instance (test.test_typing.AnnotatedTests.test_cannot_check_instance) ... ok
test_cannot_check_subclass (test.test_typing.AnnotatedTests.test_cannot_check_subclass) ... ok
test_cannot_getattr_typevar (test.test_typing.AnnotatedTests.test_cannot_getattr_typevar) ... ok
test_cannot_instantiate_forward (test.test_typing.AnnotatedTests.test_cannot_instantiate_forward) ... ok
test_cannot_instantiate_type_var (test.test_typing.AnnotatedTests.test_cannot_instantiate_type_var) ... ok
test_cannot_subclass (test.test_typing.AnnotatedTests.test_cannot_subclass) ... ok
test_deduplicate_from_union (test.test_typing.AnnotatedTests.test_deduplicate_from_union) ... ok
test_dir (test.test_typing.AnnotatedTests.test_dir) ... ok
test_flatten (test.test_typing.AnnotatedTests.test_flatten) ... ok
test_hash_eq (test.test_typing.AnnotatedTests.test_hash_eq) ... ok
test_instantiate (test.test_typing.AnnotatedTests.test_instantiate) ... ok
test_instantiate_generic (test.test_typing.AnnotatedTests.test_instantiate_generic) ... ok
test_instantiate_immutable (test.test_typing.AnnotatedTests.test_instantiate_immutable) ... ok
test_new (test.test_typing.AnnotatedTests.test_new) ... ok
test_order_in_union (test.test_typing.AnnotatedTests.test_order_in_union) ... ok
test_pickle (test.test_typing.AnnotatedTests.test_pickle) ... ok
test_repr (test.test_typing.AnnotatedTests.test_repr) ... ok
test_special_form_containment (test.test_typing.AnnotatedTests.test_special_form_containment) ... ok
test_specialize (test.test_typing.AnnotatedTests.test_specialize) ... ok
test_subst (test.test_typing.AnnotatedTests.test_subst) ... ok
test_too_few_type_args (test.test_typing.AnnotatedTests.test_too_few_type_args) ... ok
test_typevar_subst (test.test_typing.AnnotatedTests.test_typevar_subst) ... ok
test_any_instance_type_error (test.test_typing.AnyTests.test_any_instance_type_error) ... ok
test_any_works_with_alias (test.test_typing.AnyTests.test_any_works_with_alias) ... ok
test_can_subclass (test.test_typing.AnyTests.test_can_subclass) ... ok
test_cannot_instantiate (test.test_typing.AnyTests.test_cannot_instantiate) ... ok
test_errors (test.test_typing.AnyTests.test_errors) ... ok
test_multiple_inheritance_with_custom_constructors (test.test_typing.AnyTests.test_multiple_inheritance_with_custom_constructors) ... ok
test_repr (test.test_typing.AnyTests.test_repr) ... ok
test_subclassing_with_custom_constructor (test.test_typing.AnyTests.test_subclassing_with_custom_constructor) ... ok
test_exception (test.test_typing.AssertNeverTests.test_exception) ... ok
test_basics (test.test_typing.AssertTypeTests.test_basics) ... ok
test_errors (test.test_typing.AssertTypeTests.test_errors) ... ok
test_basics (test.test_typing.CastTests.test_basics) ... ok
test_errors (test.test_typing.CastTests.test_errors) ... ok
test_basics (test.test_typing.ClassVarTests.test_basics) ... ok
test_cannot_init (test.test_typing.ClassVarTests.test_cannot_init) ... ok
test_cannot_subclass (test.test_typing.ClassVarTests.test_cannot_subclass) ... ok
test_no_isinstance (test.test_typing.ClassVarTests.test_no_isinstance) ... ok
test_repr (test.test_typing.ClassVarTests.test_repr) ... ok
test_abstractset (test.test_typing.CollectionsAbcTests.test_abstractset) ... ok
test_async_generator (test.test_typing.CollectionsAbcTests.test_async_generator) ... ok
test_async_iterable (test.test_typing.CollectionsAbcTests.test_async_iterable) ... ok
test_async_iterator (test.test_typing.CollectionsAbcTests.test_async_iterator) ... ok
test_awaitable (test.test_typing.CollectionsAbcTests.test_awaitable) ... ok
test_bytestring (test.test_typing.CollectionsAbcTests.test_bytestring) ... ok
test_chainmap_instantiation (test.test_typing.CollectionsAbcTests.test_chainmap_instantiation) ... ok
test_chainmap_subclass (test.test_typing.CollectionsAbcTests.test_chainmap_subclass) ... ok
test_collection (test.test_typing.CollectionsAbcTests.test_collection) ... ok
test_collections_as_base (test.test_typing.CollectionsAbcTests.test_collections_as_base) ... ok
test_container (test.test_typing.CollectionsAbcTests.test_container) ... ok
test_coroutine (test.test_typing.CollectionsAbcTests.test_coroutine) ... ok
test_counter (test.test_typing.CollectionsAbcTests.test_counter) ... ok
test_counter_instantiation (test.test_typing.CollectionsAbcTests.test_counter_instantiation) ... ok
test_counter_subclass_instantiation (test.test_typing.CollectionsAbcTests.test_counter_subclass_instantiation) ... ok
test_defaultdict_instantiation (test.test_typing.CollectionsAbcTests.test_defaultdict_instantiation) ... ok
test_defaultdict_subclass (test.test_typing.CollectionsAbcTests.test_defaultdict_subclass) ... ok
test_deque (test.test_typing.CollectionsAbcTests.test_deque) ... ok
test_deque_instantiation (test.test_typing.CollectionsAbcTests.test_deque_instantiation) ... ok
test_dict (test.test_typing.CollectionsAbcTests.test_dict) ... ok
test_dict_subclass (test.test_typing.CollectionsAbcTests.test_dict_subclass) ... ok
test_dict_subscribe (test.test_typing.CollectionsAbcTests.test_dict_subscribe) ... ok
test_frozenset (test.test_typing.CollectionsAbcTests.test_frozenset) ... ok
test_frozenset_subclass_instantiation (test.test_typing.CollectionsAbcTests.test_frozenset_subclass_instantiation) ... ok
test_generator (test.test_typing.CollectionsAbcTests.test_generator) ... ok
test_hashable (test.test_typing.CollectionsAbcTests.test_hashable) ... ok
test_iterable (test.test_typing.CollectionsAbcTests.test_iterable) ... ok
test_iterator (test.test_typing.CollectionsAbcTests.test_iterator) ... ok
test_list (test.test_typing.CollectionsAbcTests.test_list) ... ok
test_list_subclass (test.test_typing.CollectionsAbcTests.test_list_subclass) ... ok
test_mapping (test.test_typing.CollectionsAbcTests.test_mapping) ... ok
test_mutablemapping (test.test_typing.CollectionsAbcTests.test_mutablemapping) ... ok
test_mutablesequence (test.test_typing.CollectionsAbcTests.test_mutablesequence) ... ok
test_mutableset (test.test_typing.CollectionsAbcTests.test_mutableset) ... ok
test_no_async_generator_instantiation (test.test_typing.CollectionsAbcTests.test_no_async_generator_instantiation) ... ok
test_no_dict_instantiation (test.test_typing.CollectionsAbcTests.test_no_dict_instantiation) ... ok
test_no_frozenset_instantiation (test.test_typing.CollectionsAbcTests.test_no_frozenset_instantiation) ... ok
test_no_generator_instantiation (test.test_typing.CollectionsAbcTests.test_no_generator_instantiation) ... ok
test_no_list_instantiation (test.test_typing.CollectionsAbcTests.test_no_list_instantiation) ... ok
test_no_set_instantiation (test.test_typing.CollectionsAbcTests.test_no_set_instantiation) ... ok
test_no_tuple_instantiation (test.test_typing.CollectionsAbcTests.test_no_tuple_instantiation) ... ok
test_or_and_ror (test.test_typing.CollectionsAbcTests.test_or_and_ror) ... ok
test_ordereddict_instantiation (test.test_typing.CollectionsAbcTests.test_ordereddict_instantiation) ... ok
test_ordereddict_subclass (test.test_typing.CollectionsAbcTests.test_ordereddict_subclass) ... ok
test_sequence (test.test_typing.CollectionsAbcTests.test_sequence) ... ok
test_set (test.test_typing.CollectionsAbcTests.test_set) ... ok
test_set_subclass_instantiation (test.test_typing.CollectionsAbcTests.test_set_subclass_instantiation) ... ok
test_sized (test.test_typing.CollectionsAbcTests.test_sized) ... ok
test_subclassing (test.test_typing.CollectionsAbcTests.test_subclassing) ... ok
test_subclassing_async_generator (test.test_typing.CollectionsAbcTests.test_subclassing_async_generator) ... ok
test_subclassing_register (test.test_typing.CollectionsAbcTests.test_subclassing_register) ... ok
test_subclassing_subclasshook (test.test_typing.CollectionsAbcTests.test_subclassing_subclasshook) ... ok
test_basic (test.test_typing.CollectionsCallableTests.test_basic) ... ok
test_callable_instance_type_error (test.test_typing.CollectionsCallableTests.test_callable_instance_type_error) ... ok
test_callable_instance_works (test.test_typing.CollectionsCallableTests.test_callable_instance_works) ... ok
test_callable_with_ellipsis (test.test_typing.CollectionsCallableTests.test_callable_with_ellipsis) ... ok
test_callable_wrong_forms (test.test_typing.CollectionsCallableTests.test_callable_wrong_forms) ... ok
test_cannot_instantiate (test.test_typing.CollectionsCallableTests.test_cannot_instantiate) ... ok
test_concatenate (test.test_typing.CollectionsCallableTests.test_concatenate) ... ok
test_dir (test.test_typing.CollectionsCallableTests.test_dir) ... ok
test_ellipsis_in_generic (test.test_typing.CollectionsCallableTests.test_ellipsis_in_generic) ... ok
test_eq_hash (test.test_typing.CollectionsCallableTests.test_eq_hash) ... ok
test_errors (test.test_typing.CollectionsCallableTests.test_errors) ... ERROR
test_nested_paramspec (test.test_typing.CollectionsCallableTests.test_nested_paramspec) ... ERROR
test_or_and_ror (test.test_typing.CollectionsCallableTests.test_or_and_ror) ... ok
test_paramspec (test.test_typing.CollectionsCallableTests.test_paramspec) ... ERROR
test_pickle (test.test_typing.CollectionsCallableTests.test_pickle) ... ERROR
test_repr (test.test_typing.CollectionsCallableTests.test_repr) ... ok
test_self_subclass (test.test_typing.CollectionsCallableTests.test_self_subclass) ... ok
test_type_erasure (test.test_typing.CollectionsCallableTests.test_type_erasure) ... ok
test_type_subst_error (test.test_typing.CollectionsCallableTests.test_type_subst_error) ... ok
test_var_substitution (test.test_typing.CollectionsCallableTests.test_var_substitution) ... ok
test_weakref (test.test_typing.CollectionsCallableTests.test_weakref) ... ok
test_basics (test.test_typing.ConcatenateTests.test_basics) ... ok
test_dir (test.test_typing.ConcatenateTests.test_dir) ... ok
test_invalid_uses (test.test_typing.ConcatenateTests.test_invalid_uses) ... ok
test_valid_uses (test.test_typing.ConcatenateTests.test_valid_uses) ... ok
test_var_substitution (test.test_typing.ConcatenateTests.test_var_substitution) ... ok
test_base_class (test.test_typing.DataclassTransformTests.test_base_class) ... ok
test_decorator (test.test_typing.DataclassTransformTests.test_decorator) ... ok
test_metaclass (test.test_typing.DataclassTransformTests.test_metaclass) ... ok
test_dunder_final (test.test_typing.FinalDecoratorTests.test_dunder_final) ... ok
test_final_unmodified (test.test_typing.FinalDecoratorTests.test_final_unmodified) ... ok
test_basics (test.test_typing.FinalTests.test_basics) ... ok
test_cannot_init (test.test_typing.FinalTests.test_cannot_init) ... ok
test_cannot_subclass (test.test_typing.FinalTests.test_cannot_subclass) ... ok
test_no_isinstance (test.test_typing.FinalTests.test_no_isinstance) ... ok
test_repr (test.test_typing.FinalTests.test_repr) ... ok
test_basics (test.test_typing.ForwardRefTests.test_basics) ... ok
test_callable_forward (test.test_typing.ForwardRefTests.test_callable_forward) ... ok
test_callable_with_ellipsis_forward (test.test_typing.ForwardRefTests.test_callable_with_ellipsis_forward) ... ok
test_default_globals (test.test_typing.ForwardRefTests.test_default_globals) ... ok
test_delayed_syntax_error (test.test_typing.ForwardRefTests.test_delayed_syntax_error) ... ok
test_double_forward (test.test_typing.ForwardRefTests.test_double_forward) ... ok
test_final_forward_ref (test.test_typing.ForwardRefTests.test_final_forward_ref) ... ok
test_forward_equality (test.test_typing.ForwardRefTests.test_forward_equality) ... ok
test_forward_equality_gth (test.test_typing.ForwardRefTests.test_forward_equality_gth) ... ok
test_forward_equality_hash (test.test_typing.ForwardRefTests.test_forward_equality_hash) ... ok
test_forward_equality_namespace (test.test_typing.ForwardRefTests.test_forward_equality_namespace) ... ok
test_forward_recursion_actually (test.test_typing.ForwardRefTests.test_forward_recursion_actually) ... ok
test_forward_repr (test.test_typing.ForwardRefTests.test_forward_repr) ... ok
test_forwardref_instance_type_error (test.test_typing.ForwardRefTests.test_forwardref_instance_type_error) ... ok
test_forwardref_only_str_arg (test.test_typing.ForwardRefTests.test_forwardref_only_str_arg) ... ok
test_forwardref_subclass_type_error (test.test_typing.ForwardRefTests.test_forwardref_subclass_type_error) ... ok
test_meta_no_type_check (test.test_typing.ForwardRefTests.test_meta_no_type_check) ... ok
test_name_error (test.test_typing.ForwardRefTests.test_name_error) ... ok
test_nested_classvar_fails_forward_ref_check (test.test_typing.ForwardRefTests.test_nested_classvar_fails_forward_ref_check) ... ok
test_no_type_check (test.test_typing.ForwardRefTests.test_no_type_check) ... ok
test_no_type_check_TypeError (test.test_typing.ForwardRefTests.test_no_type_check_TypeError) ... ok
test_no_type_check_class (test.test_typing.ForwardRefTests.test_no_type_check_class) ... ok
test_no_type_check_class_and_static_methods (test.test_typing.ForwardRefTests.test_no_type_check_class_and_static_methods) ... ok
test_no_type_check_foreign_functions (test.test_typing.ForwardRefTests.test_no_type_check_foreign_functions) ... ok
test_no_type_check_forward_ref_as_string (test.test_typing.ForwardRefTests.test_no_type_check_forward_ref_as_string) ... ok
test_no_type_check_lambda (test.test_typing.ForwardRefTests.test_no_type_check_lambda) ... ok
test_no_type_check_nested_types (test.test_typing.ForwardRefTests.test_no_type_check_nested_types) ... ok
test_no_type_check_no_bases (test.test_typing.ForwardRefTests.test_no_type_check_no_bases) ... ok
test_no_type_check_other_module (test.test_typing.ForwardRefTests.test_no_type_check_other_module) ... ok
test_or (test.test_typing.ForwardRefTests.test_or) ... ok
test_special_forms_forward (test.test_typing.ForwardRefTests.test_special_forms_forward) ... ok
test_syntax_error (test.test_typing.ForwardRefTests.test_syntax_error) ... ok
test_syntax_error_empty_string (test.test_typing.ForwardRefTests.test_syntax_error_empty_string) ... ok
test_tuple_forward (test.test_typing.ForwardRefTests.test_tuple_forward) ... ok
test_union_forward (test.test_typing.ForwardRefTests.test_union_forward) ... ok
test_union_forward_recursion (test.test_typing.ForwardRefTests.test_union_forward_recursion) ... ok
test_one_parameter (test.test_typing.GenericAliasSubstitutionTests.test_one_parameter) ... ok
test_three_parameters (test.test_typing.GenericAliasSubstitutionTests.test_three_parameters) ... ok
test_two_parameters (test.test_typing.GenericAliasSubstitutionTests.test_two_parameters) ... ok
test_variadic_parameters (test.test_typing.GenericAliasSubstitutionTests.test_variadic_parameters) ... ok
test_abc_bases (test.test_typing.GenericTests.test_abc_bases) ... ok
test_abc_registry_kept (test.test_typing.GenericTests.test_abc_registry_kept) ... ok
test_all_repr_eq_any (test.test_typing.GenericTests.test_all_repr_eq_any) ... ok
test_basics (test.test_typing.GenericTests.test_basics) ... ok
test_chain_repr (test.test_typing.GenericTests.test_chain_repr) ... ok
test_complex_subclasses (test.test_typing.GenericTests.test_complex_subclasses) ... ok
test_copy_and_deepcopy (test.test_typing.GenericTests.test_copy_and_deepcopy) ... ok
test_copy_generic_instances (test.test_typing.GenericTests.test_copy_generic_instances) ... ok
test_dict (test.test_typing.GenericTests.test_dict) ... ok
test_eq_1 (test.test_typing.GenericTests.test_eq_1) ... ok
test_eq_2 (test.test_typing.GenericTests.test_eq_2) ... ok
test_errors (test.test_typing.GenericTests.test_errors) ... ok
test_extended_generic_rules_eq (test.test_typing.GenericTests.test_extended_generic_rules_eq) ... ok
test_extended_generic_rules_repr (test.test_typing.GenericTests.test_extended_generic_rules_repr) ... ok
test_extended_generic_rules_subclassing (test.test_typing.GenericTests.test_extended_generic_rules_subclassing) ... ok
test_fail_with_bare_generic (test.test_typing.GenericTests.test_fail_with_bare_generic) ... ok
test_fail_with_bare_union (test.test_typing.GenericTests.test_fail_with_bare_union) ... ok
test_false_subclasses (test.test_typing.GenericTests.test_false_subclasses) ... ok
test_generic_errors (test.test_typing.GenericTests.test_generic_errors) ... ok
test_generic_forward_ref (test.test_typing.GenericTests.test_generic_forward_ref) ... ok
test_generic_hashes (test.test_typing.GenericTests.test_generic_hashes) ... ok
test_generic_pep585_forward_ref (test.test_typing.GenericTests.test_generic_pep585_forward_ref) ... ok
test_immutability_by_copy_and_pickle (test.test_typing.GenericTests.test_immutability_by_copy_and_pickle) ... 
  test_immutability_by_copy_and_pickle (test.test_typing.GenericTests.test_immutability_by_copy_and_pickle) (thing=~TP) ... ERROR
  test_immutability_by_copy_and_pickle (test.test_typing.GenericTests.test_immutability_by_copy_and_pickle) (thing=~TPB) ... ERROR
  test_immutability_by_copy_and_pickle (test.test_typing.GenericTests.test_immutability_by_copy_and_pickle) (thing=~TPV) ... ERROR
  test_immutability_by_copy_and_pickle (test.test_typing.GenericTests.test_immutability_by_copy_and_pickle) (thing=~PP) ... ERROR
test_implicit_any (test.test_typing.GenericTests.test_implicit_any) ... ok
test_init (test.test_typing.GenericTests.test_init) ... ok
test_init_subclass (test.test_typing.GenericTests.test_init_subclass) ... ok
test_init_subclass_super_called (test.test_typing.GenericTests.test_init_subclass_super_called) ... ok
test_multi_subscr_base (test.test_typing.GenericTests.test_multi_subscr_base) ... ok
test_multiple_bases (test.test_typing.GenericTests.test_multiple_bases) ... ok
test_multiple_inheritance (test.test_typing.GenericTests.test_multiple_inheritance) ... ok
test_multiple_inheritance_special (test.test_typing.GenericTests.test_multiple_inheritance_special) ... ok
test_naive_runtime_checks (test.test_typing.GenericTests.test_naive_runtime_checks) ... ok
test_nested (test.test_typing.GenericTests.test_nested) ... ok
test_new_no_args (test.test_typing.GenericTests.test_new_no_args) ... ok
test_new_repr (test.test_typing.GenericTests.test_new_repr) ... ok
test_new_repr_bare (test.test_typing.GenericTests.test_new_repr_bare) ... FAIL
test_new_repr_complex (test.test_typing.GenericTests.test_new_repr_complex) ... ok
test_new_with_args (test.test_typing.GenericTests.test_new_with_args) ... ok
test_new_with_args2 (test.test_typing.GenericTests.test_new_with_args2) ... ok
test_non_generic_subscript (test.test_typing.GenericTests.test_non_generic_subscript) ... ok
test_orig_bases (test.test_typing.GenericTests.test_orig_bases) ... ok
test_parameter_detection (test.test_typing.GenericTests.test_parameter_detection) ... ok
test_parameterized_slots (test.test_typing.GenericTests.test_parameterized_slots) ... ok
test_parameterized_slots_dict (test.test_typing.GenericTests.test_parameterized_slots_dict) ... ok
test_pep695_generic_class_with_future_annotations (test.test_typing.GenericTests.test_pep695_generic_class_with_future_annotations) ... ok
test_pep695_generic_class_with_future_annotations_and_local_shadowing (test.test_typing.GenericTests.test_pep695_generic_class_with_future_annotations_and_local_shadowing) ... ok
test_pep695_generic_class_with_future_annotations_name_clash_with_global_vars (test.test_typing.GenericTests.test_pep695_generic_class_with_future_annotations_name_clash_with_global_vars) ... ok
test_pep_695_generic_function_with_future_annotations (test.test_typing.GenericTests.test_pep_695_generic_function_with_future_annotations) ... ok
test_pep_695_generic_function_with_future_annotations_name_clash_with_global_vars (test.test_typing.GenericTests.test_pep_695_generic_function_with_future_annotations_name_clash_with_global_vars) ... ok
test_pep_695_generic_method_with_future_annotations (test.test_typing.GenericTests.test_pep_695_generic_method_with_future_annotations) ... ok
test_pep_695_generic_method_with_future_annotations_name_clash_with_global_vars (test.test_typing.GenericTests.test_pep_695_generic_method_with_future_annotations_name_clash_with_global_vars) ... ok
test_pep_695_generics_with_future_annotations_nested_in_function (test.test_typing.GenericTests.test_pep_695_generics_with_future_annotations_nested_in_function) ... ok
test_pickle (test.test_typing.GenericTests.test_pickle) ... 
  test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.args, proto=0) ... ERROR
  test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.args, proto=1) ... ERROR
  test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.args, proto=2) ... ERROR
  test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.args, proto=3) ... ERROR
  test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.args, proto=4) ... ERROR
  test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.args, proto=5) ... ERROR
  test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.kwargs, proto=0) ... ERROR
  test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.kwargs, proto=1) ... ERROR
  test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.kwargs, proto=2) ... ERROR
  test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.kwargs, proto=3) ... ERROR
  test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.kwargs, proto=4) ... ERROR
  test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.kwargs, proto=5) ... ERROR
test_repr (test.test_typing.GenericTests.test_repr) ... ok
test_repr_2 (test.test_typing.GenericTests.test_repr_2) ... ok
test_repr_3 (test.test_typing.GenericTests.test_repr_3) ... ok
test_setattr_exceptions (test.test_typing.GenericTests.test_setattr_exceptions) ... ok
test_subclass_special_form (test.test_typing.GenericTests.test_subclass_special_form) ... ok
test_subscript_meta (test.test_typing.GenericTests.test_subscript_meta) ... ok
test_subscripted_generics_as_proxies (test.test_typing.GenericTests.test_subscripted_generics_as_proxies) ... ok
test_type_erasure (test.test_typing.GenericTests.test_type_erasure) ... ok
test_type_erasure_special (test.test_typing.GenericTests.test_type_erasure_special) ... ok
test_weakref_all (test.test_typing.GenericTests.test_weakref_all) ... ok
test_forward_ref_and_final (test.test_typing.GetTypeHintTests.test_forward_ref_and_final) ... ok
test_get_type_hints_ClassVar (test.test_typing.GetTypeHintTests.test_get_type_hints_ClassVar) ... ok
test_get_type_hints_annotated (test.test_typing.GetTypeHintTests.test_get_type_hints_annotated) ... ok
test_get_type_hints_annotated_bad_module (test.test_typing.GetTypeHintTests.test_get_type_hints_annotated_bad_module) ... ok
test_get_type_hints_annotated_in_union (test.test_typing.GetTypeHintTests.test_get_type_hints_annotated_in_union) ... ok
test_get_type_hints_annotated_refs (test.test_typing.GetTypeHintTests.test_get_type_hints_annotated_refs) ... ok
test_get_type_hints_annotated_with_none_default (test.test_typing.GetTypeHintTests.test_get_type_hints_annotated_with_none_default) ... ok
test_get_type_hints_bad_module (test.test_typing.GetTypeHintTests.test_get_type_hints_bad_module) ... ok
test_get_type_hints_classes (test.test_typing.GetTypeHintTests.test_get_type_hints_classes) ... ok
test_get_type_hints_classes_no_implicit_optional (test.test_typing.GetTypeHintTests.test_get_type_hints_classes_no_implicit_optional) ... ok
test_get_type_hints_classes_str_annotations (test.test_typing.GetTypeHintTests.test_get_type_hints_classes_str_annotations) ... ok
test_get_type_hints_collections_abc_callable (test.test_typing.GetTypeHintTests.test_get_type_hints_collections_abc_callable) ... ERROR
test_get_type_hints_for_builtins (test.test_typing.GetTypeHintTests.test_get_type_hints_for_builtins) ... ok
test_get_type_hints_for_object_with_annotations (test.test_typing.GetTypeHintTests.test_get_type_hints_for_object_with_annotations) ... ok
test_get_type_hints_from_various_objects (test.test_typing.GetTypeHintTests.test_get_type_hints_from_various_objects) ... ok
test_get_type_hints_modules (test.test_typing.GetTypeHintTests.test_get_type_hints_modules) ... ok
test_get_type_hints_modules_forwardref (test.test_typing.GetTypeHintTests.test_get_type_hints_modules_forwardref) ... skipped 'known bug'
test_get_type_hints_typeddict (test.test_typing.GetTypeHintTests.test_get_type_hints_typeddict) ... ok
test_get_type_hints_wrapped_decoratored_func (test.test_typing.GetTypeHintTests.test_get_type_hints_wrapped_decoratored_func) ... ok
test_previous_behavior (test.test_typing.GetTypeHintTests.test_previous_behavior) ... ok
test_respect_no_type_check (test.test_typing.GetTypeHintTests.test_respect_no_type_check) ... ok
test_top_level_class_var (test.test_typing.GetTypeHintTests.test_top_level_class_var) ... ok
test_get_args (test.test_typing.GetUtilitiesTestCase.test_get_args) ... ERROR
test_get_origin (test.test_typing.GetUtilitiesTestCase.test_get_origin) ... ok
test_binaryio (test.test_typing.IOTests.test_binaryio) ... ok
test_io (test.test_typing.IOTests.test_io) ... ok
test_io_submodule (test.test_typing.IOTests.test_io_submodule) ... ok
test_textio (test.test_typing.IOTests.test_textio) ... ok
test_alias (test.test_typing.LiteralStringTests.test_alias) ... ok
test_basics (test.test_typing.LiteralStringTests.test_basics) ... ok
test_cannot_init (test.test_typing.LiteralStringTests.test_cannot_init) ... ok
test_cannot_subclass (test.test_typing.LiteralStringTests.test_cannot_subclass) ... ok
test_cannot_subscript (test.test_typing.LiteralStringTests.test_cannot_subscript) ... ok
test_equality (test.test_typing.LiteralStringTests.test_equality) ... ok
test_no_isinstance (test.test_typing.LiteralStringTests.test_no_isinstance) ... ok
test_repr (test.test_typing.LiteralStringTests.test_repr) ... ok
test_args (test.test_typing.LiteralTests.test_args) ... ok
test_basics (test.test_typing.LiteralTests.test_basics) ... ok
test_cannot_init (test.test_typing.LiteralTests.test_cannot_init) ... ok
test_dir (test.test_typing.LiteralTests.test_dir) ... ok
test_does_not_flatten_enum (test.test_typing.LiteralTests.test_does_not_flatten_enum) ... ok
test_enum (test.test_typing.LiteralTests.test_enum) ... ok
test_equal (test.test_typing.LiteralTests.test_equal) ... ok
test_flatten (test.test_typing.LiteralTests.test_flatten) ... ok
test_hash (test.test_typing.LiteralTests.test_hash) ... ok
test_illegal_parameters_do_not_raise_runtime_errors (test.test_typing.LiteralTests.test_illegal_parameters_do_not_raise_runtime_errors) ... ok
test_literals_inside_other_types (test.test_typing.LiteralTests.test_literals_inside_other_types) ... ok
test_no_isinstance_or_issubclass (test.test_typing.LiteralTests.test_no_isinstance_or_issubclass) ... ok
test_no_multiple_subscripts (test.test_typing.LiteralTests.test_no_multiple_subscripts) ... ok
test_no_subclassing (test.test_typing.LiteralTests.test_no_subclassing) ... ok
test_repr (test.test_typing.LiteralTests.test_repr) ... ok
test_annotation_usage (test.test_typing.NamedTupleTests.test_annotation_usage) ... ok
test_annotation_usage_with_default (test.test_typing.NamedTupleTests.test_annotation_usage_with_default) ... ok
test_annotation_usage_with_methods (test.test_typing.NamedTupleTests.test_annotation_usage_with_methods) ... ok
test_basics (test.test_typing.NamedTupleTests.test_basics) ... ok
test_copy_and_pickle (test.test_typing.NamedTupleTests.test_copy_and_pickle) ... ok
test_empty_namedtuple (test.test_typing.NamedTupleTests.test_empty_namedtuple) ... ok
test_generic (test.test_typing.NamedTupleTests.test_generic) ... ok
test_generic_pep695 (test.test_typing.NamedTupleTests.test_generic_pep695) ... ok
test_multiple_inheritance (test.test_typing.NamedTupleTests.test_multiple_inheritance) ... ok
test_namedtuple_errors (test.test_typing.NamedTupleTests.test_namedtuple_errors) ... ok
test_namedtuple_keyword_usage (test.test_typing.NamedTupleTests.test_namedtuple_keyword_usage) ... ok
test_namedtuple_special_keyword_names (test.test_typing.NamedTupleTests.test_namedtuple_special_keyword_names) ... ok
test_non_generic_subscript (test.test_typing.NamedTupleTests.test_non_generic_subscript) ... ok
test_orig_bases (test.test_typing.NamedTupleTests.test_orig_bases) ... ok
test_cannot_instantiate (test.test_typing.NeverTests.test_cannot_instantiate) ... ok
test_cannot_subclass (test.test_typing.NeverTests.test_cannot_subclass) ... ok
test_equality (test.test_typing.NeverTests.test_equality) ... ok
test_get_origin (test.test_typing.NeverTests.test_get_origin) ... ok
test_get_type_hints (test.test_typing.NeverTests.test_get_type_hints) ... ok
test_instance_type_error (test.test_typing.NeverTests.test_instance_type_error) ... ok
test_not_generic (test.test_typing.NeverTests.test_not_generic) ... ok
test_repr (test.test_typing.NeverTests.test_repr) ... ok
test_subclass_type_error (test.test_typing.NeverTests.test_subclass_type_error) ... ok
test_basic (test.test_typing.NewTypeTests.test_basic) ... ok
test_error_message_when_subclassing (test.test_typing.NewTypeTests.test_error_message_when_subclassing) ... ok
test_errors (test.test_typing.NewTypeTests.test_errors) ... ok
test_missing__name__ (test.test_typing.NewTypeTests.test_missing__name__) ... ok
test_or (test.test_typing.NewTypeTests.test_or) ... ok
test_pickle (test.test_typing.NewTypeTests.test_pickle) ... ok
test_repr (test.test_typing.NewTypeTests.test_repr) ... ok
test_special_attrs (test.test_typing.NewTypeTests.test_special_attrs) ... ok
test_cannot_instantiate (test.test_typing.NoReturnTests.test_cannot_instantiate) ... ok
test_cannot_subclass (test.test_typing.NoReturnTests.test_cannot_subclass) ... ok
test_equality (test.test_typing.NoReturnTests.test_equality) ... ok
test_get_origin (test.test_typing.NoReturnTests.test_get_origin) ... ok
test_get_type_hints (test.test_typing.NoReturnTests.test_get_type_hints) ... ok
test_instance_type_error (test.test_typing.NoReturnTests.test_instance_type_error) ... ok
test_not_equality (test.test_typing.NoReturnTests.test_not_equality) ... ok
test_not_generic (test.test_typing.NoReturnTests.test_not_generic) ... ok
test_repr (test.test_typing.NoReturnTests.test_repr) ... ok
test_subclass_type_error (test.test_typing.NoReturnTests.test_subclass_type_error) ... ok
test_basics (test.test_typing.NotRequiredTests.test_basics) ... ok
test_cannot_init (test.test_typing.NotRequiredTests.test_cannot_init) ... ok
test_cannot_subclass (test.test_typing.NotRequiredTests.test_cannot_subclass) ... ok
test_no_isinstance (test.test_typing.NotRequiredTests.test_no_isinstance) ... ok
test_repr (test.test_typing.NotRequiredTests.test_repr) ... ok
test_async_contextmanager (test.test_typing.OtherABCTests.test_async_contextmanager) ... ok
test_contextmanager (test.test_typing.OtherABCTests.test_contextmanager) ... ok
test_overload_fails (test.test_typing.OverloadTests.test_overload_fails) ... ok
test_overload_on_compiled_functions (test.test_typing.OverloadTests.test_overload_on_compiled_functions) ... skipped 'implementation detail specific to cpython'
test_overload_registry (test.test_typing.OverloadTests.test_overload_registry) ... ok
test_overload_registry_repeated (test.test_typing.OverloadTests.test_overload_registry_repeated) ... ok
test_overload_succeeds (test.test_typing.OverloadTests.test_overload_succeeds) ... ok
test_multiple_decorators (test.test_typing.OverrideDecoratorTests.test_multiple_decorators) ... ok
test_override (test.test_typing.OverrideDecoratorTests.test_override) ... ok
test_property (test.test_typing.OverrideDecoratorTests.test_property) ... ok
test_silent_failure (test.test_typing.OverrideDecoratorTests.test_silent_failure) ... ok
test_args_kwargs (test.test_typing.ParamSpecTests.test_args_kwargs) ... ok
test_bad_var_substitution (test.test_typing.ParamSpecTests.test_bad_var_substitution) ... ok
test_basic_plain (test.test_typing.ParamSpecTests.test_basic_plain) ... FAIL
test_basic_with_exec (test.test_typing.ParamSpecTests.test_basic_with_exec) ... FAIL
test_cannot_subclass (test.test_typing.ParamSpecTests.test_cannot_subclass) ... FAIL
test_multiple_paramspecs_in_user_generics (test.test_typing.ParamSpecTests.test_multiple_paramspecs_in_user_generics) ... ok
test_paramspec_gets_copied (test.test_typing.ParamSpecTests.test_paramspec_gets_copied) ... ok
test_paramspec_in_nested_generics (test.test_typing.ParamSpecTests.test_paramspec_in_nested_generics) ... ok
test_stringized (test.test_typing.ParamSpecTests.test_stringized) ... ok
test_type_var_subst_for_other_type_vars (test.test_typing.ParamSpecTests.test_type_var_subst_for_other_type_vars) ... ok
test_typevartuple_and_paramspecs_in_generic_aliases (test.test_typing.ParamSpecTests.test_typevartuple_and_paramspecs_in_generic_aliases) ... 
  test_typevartuple_and_paramspecs_in_generic_aliases (test.test_typing.ParamSpecTests.test_typevartuple_and_paramspecs_in_generic_aliases) (generic=<class 'collections.abc.Callable'>) ... ERROR
test_typevartuple_and_paramspecs_in_user_generics (test.test_typing.ParamSpecTests.test_typevartuple_and_paramspecs_in_user_generics) ... ok
test_user_generics (test.test_typing.ParamSpecTests.test_user_generics) ... ok
test_valid_uses (test.test_typing.ParamSpecTests.test_valid_uses) ... ERROR
test_var_substitution (test.test_typing.ParamSpecTests.test_var_substitution) ... ok
test_basic_protocol (test.test_typing.ProtocolTests.test_basic_protocol) ... ok
test_builtin_protocol_allowlist (test.test_typing.ProtocolTests.test_builtin_protocol_allowlist) ... ok
test_bundled_protocol_instance_works (test.test_typing.ProtocolTests.test_bundled_protocol_instance_works) ... ok
test_cannot_instantiate_abstract (test.test_typing.ProtocolTests.test_cannot_instantiate_abstract) ... ok
test_collections_protocols_allowed (test.test_typing.ProtocolTests.test_collections_protocols_allowed) ... ok
test_concrete_class_inheriting_init_from_protocol (test.test_typing.ProtocolTests.test_concrete_class_inheriting_init_from_protocol) ... ok
test_custom_subclasshook (test.test_typing.ProtocolTests.test_custom_subclasshook) ... ok
test_custom_subclasshook_2 (test.test_typing.ProtocolTests.test_custom_subclasshook_2) ... ok
test_defining_generic_protocols (test.test_typing.ProtocolTests.test_defining_generic_protocols) ... ok
test_defining_generic_protocols_old_style (test.test_typing.ProtocolTests.test_defining_generic_protocols_old_style) ... ok
test_empty_protocol_decorated_with_final (test.test_typing.ProtocolTests.test_empty_protocol_decorated_with_final) ... ok
test_everything_implements_empty_protocol (test.test_typing.ProtocolTests.test_everything_implements_empty_protocol) ... ok
test_function_implements_protocol (test.test_typing.ProtocolTests.test_function_implements_protocol) ... ok
test_generic_protocols_eq (test.test_typing.ProtocolTests.test_generic_protocols_eq) ... ok
test_generic_protocols_repr (test.test_typing.ProtocolTests.test_generic_protocols_repr) ... ok
test_generic_protocols_special_from_generic (test.test_typing.ProtocolTests.test_generic_protocols_special_from_generic) ... ok
test_generic_protocols_special_from_protocol (test.test_typing.ProtocolTests.test_generic_protocols_special_from_protocol) ... ok
test_implicit_issubclass_between_two_protocols (test.test_typing.ProtocolTests.test_implicit_issubclass_between_two_protocols) ... ok
test_init_called (test.test_typing.ProtocolTests.test_init_called) ... ok
test_interaction_with_isinstance_checks_on_superclasses_with_ABCMeta (test.test_typing.ProtocolTests.test_interaction_with_isinstance_checks_on_superclasses_with_ABCMeta) ... ok
test_interaction_with_isinstance_checks_on_superclasses_with_ABCMeta_2 (test.test_typing.ProtocolTests.test_interaction_with_isinstance_checks_on_superclasses_with_ABCMeta_2) ... ok
test_isinstance_checks_not_at_whim_of_gc (test.test_typing.ProtocolTests.test_isinstance_checks_not_at_whim_of_gc) ... ok
test_issubclass_and_isinstance_on_Protocol_itself (test.test_typing.ProtocolTests.test_issubclass_and_isinstance_on_Protocol_itself) ... ok
test_issubclass_fails_correctly (test.test_typing.ProtocolTests.test_issubclass_fails_correctly) ... ok
test_new_called (test.test_typing.ProtocolTests.test_new_called) ... ok
test_no_inheritance_from_nominal (test.test_typing.ProtocolTests.test_no_inheritance_from_nominal) ... ok
test_no_instantiation (test.test_typing.ProtocolTests.test_no_instantiation) ... ok
test_no_runtime_deco_on_nominal (test.test_typing.ProtocolTests.test_no_runtime_deco_on_nominal) ... ok
test_no_weird_caching_with_issubclass_after_isinstance (test.test_typing.ProtocolTests.test_no_weird_caching_with_issubclass_after_isinstance) ... ok
test_no_weird_caching_with_issubclass_after_isinstance_2 (test.test_typing.ProtocolTests.test_no_weird_caching_with_issubclass_after_isinstance_2) ... ok
test_no_weird_caching_with_issubclass_after_isinstance_3 (test.test_typing.ProtocolTests.test_no_weird_caching_with_issubclass_after_isinstance_3) ... ok
test_no_weird_caching_with_issubclass_after_isinstance_pep695 (test.test_typing.ProtocolTests.test_no_weird_caching_with_issubclass_after_isinstance_pep695) ... ok
test_non_protocol_subclasses (test.test_typing.ProtocolTests.test_non_protocol_subclasses) ... ok
test_non_runtime_protocol_isinstance_check (test.test_typing.ProtocolTests.test_non_runtime_protocol_isinstance_check) ... ok
test_none_on_callable_blocks_implementation (test.test_typing.ProtocolTests.test_none_on_callable_blocks_implementation) ... ok
test_none_on_non_callable_doesnt_block_implementation (test.test_typing.ProtocolTests.test_none_on_non_callable_doesnt_block_implementation) ... ok
test_none_treated_correctly (test.test_typing.ProtocolTests.test_none_treated_correctly) ... ok
test_nonruntime_protocol_interaction_with_evil_classproperty (test.test_typing.ProtocolTests.test_nonruntime_protocol_interaction_with_evil_classproperty) ... ok
test_pep695_generic_protocol_callable_members (test.test_typing.ProtocolTests.test_pep695_generic_protocol_callable_members) ... ok
test_pep695_generics_can_be_runtime_checkable (test.test_typing.ProtocolTests.test_pep695_generics_can_be_runtime_checkable) ... ok
test_protocol_checks_after_subscript (test.test_typing.ProtocolTests.test_protocol_checks_after_subscript) ... ok
test_protocol_decorated_with_final_callable_members (test.test_typing.ProtocolTests.test_protocol_decorated_with_final_callable_members) ... ok
test_protocol_decorated_with_final_mixed_members (test.test_typing.ProtocolTests.test_protocol_decorated_with_final_mixed_members) ... ok
test_protocol_decorated_with_final_noncallable_members (test.test_typing.ProtocolTests.test_protocol_decorated_with_final_noncallable_members) ... ok
test_protocol_defining_init_does_not_get_overridden (test.test_typing.ProtocolTests.test_protocol_defining_init_does_not_get_overridden) ... ok
test_protocols_bad_subscripts (test.test_typing.ProtocolTests.test_protocols_bad_subscripts) ... ok
test_protocols_in_unions (test.test_typing.ProtocolTests.test_protocols_in_unions) ... ok
test_protocols_isinstance (test.test_typing.ProtocolTests.test_protocols_isinstance) ... ok
test_protocols_isinstance___slots__ (test.test_typing.ProtocolTests.test_protocols_isinstance___slots__) ... ok
test_protocols_isinstance_attribute_access_with_side_effects (test.test_typing.ProtocolTests.test_protocols_isinstance_attribute_access_with_side_effects) ... ok
test_protocols_isinstance_init (test.test_typing.ProtocolTests.test_protocols_isinstance_init) ... ok
test_protocols_isinstance_monkeypatching (test.test_typing.ProtocolTests.test_protocols_isinstance_monkeypatching) ... ok
test_protocols_isinstance_not_fooled_by_custom_dir (test.test_typing.ProtocolTests.test_protocols_isinstance_not_fooled_by_custom_dir) ... ok
test_protocols_isinstance_properties_and_descriptors (test.test_typing.ProtocolTests.test_protocols_isinstance_properties_and_descriptors) ... ok
test_protocols_isinstance_py36 (test.test_typing.ProtocolTests.test_protocols_isinstance_py36) ... ok
test_protocols_issubclass (test.test_typing.ProtocolTests.test_protocols_issubclass) ... ok
test_protocols_issubclass_non_callable (test.test_typing.ProtocolTests.test_protocols_issubclass_non_callable) ... ok
test_protocols_pickleable (test.test_typing.ProtocolTests.test_protocols_pickleable) ... ok
test_protocols_support_register (test.test_typing.ProtocolTests.test_protocols_support_register) ... ok
test_reversible (test.test_typing.ProtocolTests.test_reversible) ... ok
test_runtime_checkable_generic (test.test_typing.ProtocolTests.test_runtime_checkable_generic) ... ok
test_runtime_checkable_generic_non_protocol (test.test_typing.ProtocolTests.test_runtime_checkable_generic_non_protocol) ... ok
test_runtime_protocol_interaction_with_evil_classproperty (test.test_typing.ProtocolTests.test_runtime_protocol_interaction_with_evil_classproperty) ... ok
test_subprotocols_extending (test.test_typing.ProtocolTests.test_subprotocols_extending) ... ok
test_subprotocols_merging (test.test_typing.ProtocolTests.test_subprotocols_merging) ... ok
test_super_call_init (test.test_typing.ProtocolTests.test_super_call_init) ... ok
test_supports_abs (test.test_typing.ProtocolTests.test_supports_abs) ... ok
test_supports_bytes (test.test_typing.ProtocolTests.test_supports_bytes) ... ok
test_supports_complex (test.test_typing.ProtocolTests.test_supports_complex) ... ok
test_supports_float (test.test_typing.ProtocolTests.test_supports_float) ... ok
test_supports_index (test.test_typing.ProtocolTests.test_supports_index) ... ok
test_supports_int (test.test_typing.ProtocolTests.test_supports_int) ... ok
test_supports_round (test.test_typing.ProtocolTests.test_supports_round) ... ok
test_alias_equality (test.test_typing.RETests.test_alias_equality) ... ok
test_basics (test.test_typing.RETests.test_basics) ... ok
test_cannot_subclass (test.test_typing.RETests.test_cannot_subclass) ... ok
test_errors (test.test_typing.RETests.test_errors) ... ok
test_re_submodule (test.test_typing.RETests.test_re_submodule) ... ok
test_re_submodule_access_basics (test.test_typing.RETests.test_re_submodule_access_basics) ... ok
test_repr (test.test_typing.RETests.test_repr) ... ok
test_basics (test.test_typing.RequiredTests.test_basics) ... ok
test_cannot_init (test.test_typing.RequiredTests.test_cannot_init) ... ok
test_cannot_subclass (test.test_typing.RequiredTests.test_cannot_subclass) ... ok
test_no_isinstance (test.test_typing.RequiredTests.test_no_isinstance) ... ok
test_repr (test.test_typing.RequiredTests.test_repr) ... ok
test_reveal_type (test.test_typing.RevealTypeTests.test_reveal_type) ... ok
test_alias (test.test_typing.SelfTests.test_alias) ... ok
test_basics (test.test_typing.SelfTests.test_basics) ... ok
test_cannot_init (test.test_typing.SelfTests.test_cannot_init) ... ok
test_cannot_subclass (test.test_typing.SelfTests.test_cannot_subclass) ... ok
test_cannot_subscript (test.test_typing.SelfTests.test_cannot_subscript) ... ok
test_equality (test.test_typing.SelfTests.test_equality) ... ok
test_no_isinstance (test.test_typing.SelfTests.test_no_isinstance) ... ok
test_repr (test.test_typing.SelfTests.test_repr) ... ok
test_genericalias_dir (test.test_typing.SpecialAttrsTests.test_genericalias_dir) ... ok
test_special_attrs (test.test_typing.SpecialAttrsTests.test_special_attrs) ... 
  test_special_attrs (test.test_typing.SpecialAttrsTests.test_special_attrs) (cls=<class '_pypy_typing.TypeVar'>) ... FAIL
  test_special_attrs (test.test_typing.SpecialAttrsTests.test_special_attrs) (cls=typing.Concatenate[typing.Any, ~SpecialAttrsP]) ... ERROR
test_special_attrs2 (test.test_typing.SpecialAttrsTests.test_special_attrs2) ... FAIL
test_no_duplicates_if_replacement_not_in_templates (test.test_typing.TemplateReplacementTests.test_no_duplicates_if_replacement_not_in_templates) ... ok
test_two_templates_two_replacements_yields_correct_renders (test.test_typing.TemplateReplacementTests.test_two_templates_two_replacements_yields_correct_renders) ... ok
test_c_functions (test.test_typing.TestModules.test_c_functions) ... ok
test_basics (test.test_typing.TupleTests.test_basics) ... ok
test_equality (test.test_typing.TupleTests.test_equality) ... ok
test_errors (test.test_typing.TupleTests.test_errors) ... ok
test_repr (test.test_typing.TupleTests.test_repr) ... ok
test_tuple_instance_type_error (test.test_typing.TupleTests.test_tuple_instance_type_error) ... ok
test_tuple_subclass (test.test_typing.TupleTests.test_tuple_subclass) ... ok
test_cannot_instantiate (test.test_typing.TypeAliasTests.test_cannot_instantiate) ... ok
test_cannot_subclass (test.test_typing.TypeAliasTests.test_cannot_subclass) ... ok
test_cannot_subscript (test.test_typing.TypeAliasTests.test_cannot_subscript) ... ok
test_canonical_usage_with_type_comment (test.test_typing.TypeAliasTests.test_canonical_usage_with_type_comment) ... ok
test_canonical_usage_with_variable_annotation (test.test_typing.TypeAliasTests.test_canonical_usage_with_variable_annotation) ... ok
test_no_isinstance (test.test_typing.TypeAliasTests.test_no_isinstance) ... ok
test_no_issubclass (test.test_typing.TypeAliasTests.test_no_issubclass) ... ok
test_repr (test.test_typing.TypeAliasTests.test_repr) ... ok
test_stringized_usage (test.test_typing.TypeAliasTests.test_stringized_usage) ... ok
test_basics (test.test_typing.TypeGuardTests.test_basics) ... ok
test_cannot_init (test.test_typing.TypeGuardTests.test_cannot_init) ... ok
test_cannot_subclass (test.test_typing.TypeGuardTests.test_cannot_subclass) ... ok
test_no_isinstance (test.test_typing.TypeGuardTests.test_no_isinstance) ... ok
test_repr (test.test_typing.TypeGuardTests.test_repr) ... ok
test_cannot_iterate (test.test_typing.TypeIterationTests.test_cannot_iterate) ... ok
test_is_not_instance_of_iterable (test.test_typing.TypeIterationTests.test_is_not_instance_of_iterable) ... ok
test_type_basic (test.test_typing.TypeTests.test_type_basic) ... ok
test_type_optional (test.test_typing.TypeTests.test_type_optional) ... ok
test_type_typevar (test.test_typing.TypeTests.test_type_typevar) ... ok
test_attributes (test.test_typing.TypeVarTests.test_attributes) ... ok
test_bad_var_substitution (test.test_typing.TypeVarTests.test_bad_var_substitution) ... ok
test_basic_plain (test.test_typing.TypeVarTests.test_basic_plain) ... FAIL
test_basic_with_exec (test.test_typing.TypeVarTests.test_basic_with_exec) ... FAIL
test_bound_errors (test.test_typing.TypeVarTests.test_bound_errors) ... ok
test_cannot_combine_explicit_and_infer (test.test_typing.TypeVarTests.test_cannot_combine_explicit_and_infer) ... FAIL
test_cannot_instantiate_vars (test.test_typing.TypeVarTests.test_cannot_instantiate_vars) ... ok
test_cannot_subclass (test.test_typing.TypeVarTests.test_cannot_subclass) ... FAIL
test_constrained_error (test.test_typing.TypeVarTests.test_constrained_error) ... ok
test_constructor (test.test_typing.TypeVarTests.test_constructor) ... ok
test_many_weakrefs (test.test_typing.TypeVarTests.test_many_weakrefs) ... ok
test_missing__name__ (test.test_typing.TypeVarTests.test_missing__name__) ... ok
test_no_bivariant (test.test_typing.TypeVarTests.test_no_bivariant) ... ok
test_no_redefinition (test.test_typing.TypeVarTests.test_no_redefinition) ... ok
test_or (test.test_typing.TypeVarTests.test_or) ... ok
test_repr (test.test_typing.TypeVarTests.test_repr) ... ok
test_typevar_instance_type_error (test.test_typing.TypeVarTests.test_typevar_instance_type_error) ... ok
test_typevar_subclass_type_error (test.test_typing.TypeVarTests.test_typevar_subclass_type_error) ... ok
test_union_constrained (test.test_typing.TypeVarTests.test_union_constrained) ... ok
test_union_unique (test.test_typing.TypeVarTests.test_union_unique) ... ok
test_var_substitution (test.test_typing.TypeVarTests.test_var_substitution) ... ok
test_pickling_then_unpickling_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_results_in_same_identity) ... 
  test_pickling_then_unpickling_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_results_in_same_identity) (pickle_proto=0) ... ERROR
  test_pickling_then_unpickling_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_results_in_same_identity) (pickle_proto=1) ... ERROR
  test_pickling_then_unpickling_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_results_in_same_identity) (pickle_proto=2) ... ERROR
  test_pickling_then_unpickling_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_results_in_same_identity) (pickle_proto=3) ... ERROR
  test_pickling_then_unpickling_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_results_in_same_identity) (pickle_proto=4) ... ERROR
  test_pickling_then_unpickling_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_results_in_same_identity) (pickle_proto=5) ... ERROR
test_pickling_then_unpickling_tuple_with_typevartuple_equality (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_tuple_with_typevartuple_equality) ... 
  test_pickling_then_unpickling_tuple_with_typevartuple_equality (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_tuple_with_typevartuple_equality) (pickle_proto=0) ... ERROR
  test_pickling_then_unpickling_tuple_with_typevartuple_equality (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_tuple_with_typevartuple_equality) (pickle_proto=1) ... ERROR
  test_pickling_then_unpickling_tuple_with_typevartuple_equality (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_tuple_with_typevartuple_equality) (pickle_proto=2) ... ERROR
  test_pickling_then_unpickling_tuple_with_typevartuple_equality (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_tuple_with_typevartuple_equality) (pickle_proto=3) ... ERROR
  test_pickling_then_unpickling_tuple_with_typevartuple_equality (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_tuple_with_typevartuple_equality) (pickle_proto=4) ... ERROR
  test_pickling_then_unpickling_tuple_with_typevartuple_equality (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_tuple_with_typevartuple_equality) (pickle_proto=5) ... ERROR
test_pickling_then_unpickling_unpacked_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_unpacked_results_in_same_identity) ... 
  test_pickling_then_unpickling_unpacked_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_unpacked_results_in_same_identity) (pickle_proto=0) ... ERROR
  test_pickling_then_unpickling_unpacked_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_unpacked_results_in_same_identity) (pickle_proto=1) ... ERROR
  test_pickling_then_unpickling_unpacked_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_unpacked_results_in_same_identity) (pickle_proto=2) ... ERROR
  test_pickling_then_unpickling_unpacked_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_unpacked_results_in_same_identity) (pickle_proto=3) ... ERROR
  test_pickling_then_unpickling_unpacked_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_unpacked_results_in_same_identity) (pickle_proto=4) ... ERROR
  test_pickling_then_unpickling_unpacked_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_unpacked_results_in_same_identity) (pickle_proto=5) ... ERROR
test_bad_var_substitution (test.test_typing.TypeVarTupleTests.test_bad_var_substitution) ... FAIL
test_callable_args_are_correct (test.test_typing.TypeVarTupleTests.test_callable_args_are_correct) ... ok
test_cannot_call_instance (test.test_typing.TypeVarTupleTests.test_cannot_call_instance) ... ok
test_cannot_subclass (test.test_typing.TypeVarTupleTests.test_cannot_subclass) ... FAIL
test_concatenation_in_variadic_args_annotations_are_correct (test.test_typing.TypeVarTupleTests.test_concatenation_in_variadic_args_annotations_are_correct) ... ok
test_different_instances_are_different (test.test_typing.TypeVarTupleTests.test_different_instances_are_different) ... ok
test_exec (test.test_typing.TypeVarTupleTests.test_exec) ... FAIL
test_get_type_hints_on_unpack_args (test.test_typing.TypeVarTupleTests.test_get_type_hints_on_unpack_args) ... ok
test_get_type_hints_on_unpack_args_string (test.test_typing.TypeVarTupleTests.test_get_type_hints_on_unpack_args_string) ... ok
test_instance_is_equal_to_itself (test.test_typing.TypeVarTupleTests.test_instance_is_equal_to_itself) ... ok
test_instance_isinstance_of_typevartuple (test.test_typing.TypeVarTupleTests.test_instance_isinstance_of_typevartuple) ... ok
test_module (test.test_typing.TypeVarTupleTests.test_module) ... FAIL
test_name (test.test_typing.TypeVarTupleTests.test_name) ... ok
test_parameterised_tuple_is_equal_to_itself (test.test_typing.TypeVarTupleTests.test_parameterised_tuple_is_equal_to_itself) ... ok
test_repr_is_correct (test.test_typing.TypeVarTupleTests.test_repr_is_correct) ... ok
test_tuple_args_and_parameters_are_correct (test.test_typing.TypeVarTupleTests.test_tuple_args_and_parameters_are_correct) ... ok
test_tuple_args_are_correct (test.test_typing.TypeVarTupleTests.test_tuple_args_are_correct) ... ok
test_type_concatenation_in_tuple_argument_list_succeeds (test.test_typing.TypeVarTupleTests.test_type_concatenation_in_tuple_argument_list_succeeds) ... ok
test_type_concatenation_in_variadic_class_argument_list_succeeds (test.test_typing.TypeVarTupleTests.test_type_concatenation_in_variadic_class_argument_list_succeeds) ... ok
test_unpacked_typevartuple_is_equal_to_itself (test.test_typing.TypeVarTupleTests.test_unpacked_typevartuple_is_equal_to_itself) ... ok
test_var_substitution (test.test_typing.TypeVarTupleTests.test_var_substitution) ... ok
test_variadic_args_annotations_are_correct (test.test_typing.TypeVarTupleTests.test_variadic_args_annotations_are_correct) ... ok
test_variadic_args_with_ellipsis_annotations_are_correct (test.test_typing.TypeVarTupleTests.test_variadic_args_with_ellipsis_annotations_are_correct) ... ok
test_variadic_class_alias_repr_is_correct (test.test_typing.TypeVarTupleTests.test_variadic_class_alias_repr_is_correct) ... ok
test_variadic_class_arg_ordering_matters (test.test_typing.TypeVarTupleTests.test_variadic_class_arg_ordering_matters) ... ok
test_variadic_class_arg_typevartuple_identity_matters (test.test_typing.TypeVarTupleTests.test_variadic_class_arg_typevartuple_identity_matters) ... ok
test_variadic_class_args_are_correct (test.test_typing.TypeVarTupleTests.test_variadic_class_args_are_correct) ... ok
test_variadic_class_definition_using_concrete_types_fails (test.test_typing.TypeVarTupleTests.test_variadic_class_definition_using_concrete_types_fails) ... ok
test_variadic_class_definition_using_packed_typevartuple_fails (test.test_typing.TypeVarTupleTests.test_variadic_class_definition_using_packed_typevartuple_fails) ... FAIL
test_variadic_class_origin_is_correct (test.test_typing.TypeVarTupleTests.test_variadic_class_origin_is_correct) ... ok
test_variadic_class_repr_is_correct (test.test_typing.TypeVarTupleTests.test_variadic_class_repr_is_correct) ... ok
test_variadic_class_same_args_results_in_equalty (test.test_typing.TypeVarTupleTests.test_variadic_class_same_args_results_in_equalty) ... ok
test_variadic_class_with_2_typevars_accepts_2_or_more_args (test.test_typing.TypeVarTupleTests.test_variadic_class_with_2_typevars_accepts_2_or_more_args) ... ok
test_variadic_class_with_duplicate_typevartuples_fails (test.test_typing.TypeVarTupleTests.test_variadic_class_with_duplicate_typevartuples_fails) ... ok
tests_tuple_arg_ordering_matters (test.test_typing.TypeVarTupleTests.tests_tuple_arg_ordering_matters) ... ok
test_basics_functional_syntax (test.test_typing.TypedDictTests.test_basics_functional_syntax) ... ok
test_basics_keywords_syntax (test.test_typing.TypedDictTests.test_basics_keywords_syntax) ... ok
test_generic_inheritance (test.test_typing.TypedDictTests.test_generic_inheritance) ... ok
test_get_type_hints (test.test_typing.TypedDictTests.test_get_type_hints) ... ok
test_get_type_hints_generic (test.test_typing.TypedDictTests.test_get_type_hints_generic) ... ok
test_implicit_any_inheritance (test.test_typing.TypedDictTests.test_implicit_any_inheritance) ... ok
test_is_typeddict (test.test_typing.TypedDictTests.test_is_typeddict) ... ok
test_keys_inheritance (test.test_typing.TypedDictTests.test_keys_inheritance) ... ok
test_keys_inheritance_with_same_name (test.test_typing.TypedDictTests.test_keys_inheritance_with_same_name) ... ok
test_multiple_inheritance (test.test_typing.TypedDictTests.test_multiple_inheritance) ... ok
test_multiple_inheritance_with_same_key (test.test_typing.TypedDictTests.test_multiple_inheritance_with_same_key) ... ok
test_non_generic_subscript (test.test_typing.TypedDictTests.test_non_generic_subscript) ... ok
test_optional (test.test_typing.TypedDictTests.test_optional) ... ok
test_optional_keys (test.test_typing.TypedDictTests.test_optional_keys) ... ok
test_orig_bases (test.test_typing.TypedDictTests.test_orig_bases) ... ok
test_pep695_generic_typeddict (test.test_typing.TypedDictTests.test_pep695_generic_typeddict) ... ok
test_pickle (test.test_typing.TypedDictTests.test_pickle) ... ok
test_pickle_generic (test.test_typing.TypedDictTests.test_pickle_generic) ... ok
test_py36_class_syntax_usage (test.test_typing.TypedDictTests.test_py36_class_syntax_usage) ... ok
test_required_notrequired_keys (test.test_typing.TypedDictTests.test_required_notrequired_keys) ... ok
test_total (test.test_typing.TypedDictTests.test_total) ... ok
test_typeddict_create_errors (test.test_typing.TypedDictTests.test_typeddict_create_errors) ... ok
test_typeddict_errors (test.test_typing.TypedDictTests.test_typeddict_errors) ... ok
test_typeddict_special_keyword_names (test.test_typing.TypedDictTests.test_typeddict_special_keyword_names) ... ok
test_basic (test.test_typing.TypingCallableTests.test_basic) ... ok
test_callable_instance_type_error (test.test_typing.TypingCallableTests.test_callable_instance_type_error) ... ok
test_callable_instance_works (test.test_typing.TypingCallableTests.test_callable_instance_works) ... ok
test_callable_with_ellipsis (test.test_typing.TypingCallableTests.test_callable_with_ellipsis) ... ok
test_callable_wrong_forms (test.test_typing.TypingCallableTests.test_callable_wrong_forms) ... ok
test_cannot_instantiate (test.test_typing.TypingCallableTests.test_cannot_instantiate) ... ok
test_concatenate (test.test_typing.TypingCallableTests.test_concatenate) ... ok
test_consistency (test.test_typing.TypingCallableTests.test_consistency) ... ok
test_dir (test.test_typing.TypingCallableTests.test_dir) ... ok
test_ellipsis_in_generic (test.test_typing.TypingCallableTests.test_ellipsis_in_generic) ... ok
test_eq_hash (test.test_typing.TypingCallableTests.test_eq_hash) ... ok
test_errors (test.test_typing.TypingCallableTests.test_errors) ... ok
test_nested_paramspec (test.test_typing.TypingCallableTests.test_nested_paramspec) ... ok
test_or_and_ror (test.test_typing.TypingCallableTests.test_or_and_ror) ... ok
test_paramspec (test.test_typing.TypingCallableTests.test_paramspec) ... ok
test_pickle (test.test_typing.TypingCallableTests.test_pickle) ... 
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, int], proto=0) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, int], proto=1) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, int], proto=2) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, int], proto=3) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, int], proto=4) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, int], proto=5) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, ~T_pickle], proto=0) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, ~T_pickle], proto=1) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, ~T_pickle], proto=2) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, ~T_pickle], proto=3) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, ~T_pickle], proto=4) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, ~T_pickle], proto=5) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[int, ~P_pickle], int], proto=0) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[int, ~P_pickle], int], proto=1) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[int, ~P_pickle], int], proto=2) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[int, ~P_pickle], int], proto=3) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[int, ~P_pickle], int], proto=4) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[int, ~P_pickle], int], proto=5) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[typing.Unpack[TS_pickle], ~P_pickle], int], proto=0) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[typing.Unpack[TS_pickle], ~P_pickle], int], proto=1) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[typing.Unpack[TS_pickle], ~P_pickle], int], proto=2) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[typing.Unpack[TS_pickle], ~P_pickle], int], proto=3) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[typing.Unpack[TS_pickle], ~P_pickle], int], proto=4) ... ERROR
  test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[typing.Unpack[TS_pickle], ~P_pickle], int], proto=5) ... ERROR
test_repr (test.test_typing.TypingCallableTests.test_repr) ... ok
test_self_subclass (test.test_typing.TypingCallableTests.test_self_subclass) ... ok
test_type_erasure (test.test_typing.TypingCallableTests.test_type_erasure) ... ok
test_type_subst_error (test.test_typing.TypingCallableTests.test_type_subst_error) ... ok
test_var_substitution (test.test_typing.TypingCallableTests.test_var_substitution) ... ok
test_weakref (test.test_typing.TypingCallableTests.test_weakref) ... ok
test_base_class_kept (test.test_typing.UnionTests.test_base_class_kept) ... ok
test_basics (test.test_typing.UnionTests.test_basics) ... ok
test_cannot_instantiate (test.test_typing.UnionTests.test_cannot_instantiate) ... ok
test_cannot_subclass (test.test_typing.UnionTests.test_cannot_subclass) ... ok
test_dir (test.test_typing.UnionTests.test_dir) ... ok
test_empty (test.test_typing.UnionTests.test_empty) ... ok
test_etree (test.test_typing.UnionTests.test_etree) ... ok
test_function_repr_union (test.test_typing.UnionTests.test_function_repr_union) ... ok
test_no_eval_union (test.test_typing.UnionTests.test_no_eval_union) ... ok
test_optional (test.test_typing.UnionTests.test_optional) ... ok
test_optional_isinstance (test.test_typing.UnionTests.test_optional_isinstance) ... ok
test_optional_isinstance_type_error (test.test_typing.UnionTests.test_optional_isinstance_type_error) ... ok
test_optional_issubclass (test.test_typing.UnionTests.test_optional_issubclass) ... ok
test_optional_issubclass_type_error (test.test_typing.UnionTests.test_optional_issubclass_type_error) ... ok
test_repr (test.test_typing.UnionTests.test_repr) ... ok
test_single_class_disappears (test.test_typing.UnionTests.test_single_class_disappears) ... ok
test_union_any (test.test_typing.UnionTests.test_union_any) ... ok
test_union_compare_other (test.test_typing.UnionTests.test_union_compare_other) ... ok
test_union_generalization (test.test_typing.UnionTests.test_union_generalization) ... ok
test_union_isinstance (test.test_typing.UnionTests.test_union_isinstance) ... ok
test_union_isinstance_type_error (test.test_typing.UnionTests.test_union_isinstance_type_error) ... ok
test_union_issubclass (test.test_typing.UnionTests.test_union_issubclass) ... ok
test_union_issubclass_type_error (test.test_typing.UnionTests.test_union_issubclass_type_error) ... ok
test_union_object (test.test_typing.UnionTests.test_union_object) ... ok
test_union_of_literals (test.test_typing.UnionTests.test_union_of_literals) ... ok
test_union_of_unhashable (test.test_typing.UnionTests.test_union_of_unhashable) ... ok
test_union_str_pattern (test.test_typing.UnionTests.test_union_str_pattern) ... ok
test_union_union (test.test_typing.UnionTests.test_union_union) ... ok
test_unordered (test.test_typing.UnionTests.test_unordered) ... ok
test_accepts_single_type (test.test_typing.UnpackTests.test_accepts_single_type) ... ok
test_builtin_tuple (test.test_typing.UnpackTests.test_builtin_tuple) ... ok
test_cannot_be_called (test.test_typing.UnpackTests.test_cannot_be_called) ... ok
test_dir (test.test_typing.UnpackTests.test_dir) ... ok
test_rejects_multiple_parameterization (test.test_typing.UnpackTests.test_rejects_multiple_parameterization) ... ok
test_rejects_multiple_types (test.test_typing.UnpackTests.test_rejects_multiple_types) ... ok
test_unpack_wrong_type (test.test_typing.UnpackTests.test_unpack_wrong_type) ... ok
test_usage_with_kwargs (test.test_typing.UnpackTests.test_usage_with_kwargs) ... ok
TypedDict (typing)
Doctest: typing.TypedDict ... ok
_collect_parameters (typing)
Doctest: typing._collect_parameters ... ok
_should_unflatten_callable_args (typing)
Doctest: typing._should_unflatten_callable_args ... FAIL
get_args (typing)
Doctest: typing.get_args ... ok
get_origin (typing)
Doctest: typing.get_origin ... ok
is_typeddict (typing)
Doctest: typing.is_typeddict ... ok

======================================================================
ERROR: test_errors (test.test_typing.CollectionsCallableTests.test_errors)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2404, in test_errors
    C1 = Callable[P, T]
         ~~~~~~~~^^^^^^
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/_collections_abc.py", line 477, in __new__
    raise TypeError(f"Expected a list of types, an ellipsis, "
TypeError: Expected a list of types, an ellipsis, ParamSpec, or Concatenate. Got ~P

======================================================================
ERROR: test_nested_paramspec (test.test_typing.CollectionsCallableTests.test_nested_paramspec)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2370, in test_nested_paramspec
    C1 = My[[int, T2], Callable[P2, T2]]
                       ~~~~~~~~^^^^^^^^
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/_collections_abc.py", line 477, in __new__
    raise TypeError(f"Expected a list of types, an ellipsis, "
TypeError: Expected a list of types, an ellipsis, ParamSpec, or Concatenate. Got ~P2

======================================================================
ERROR: test_paramspec (test.test_typing.CollectionsCallableTests.test_paramspec)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2300, in test_paramspec
    C1 = Callable[P, T]
         ~~~~~~~~^^^^^^
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/_collections_abc.py", line 477, in __new__
    raise TypeError(f"Expected a list of types, an ellipsis, "
TypeError: Expected a list of types, an ellipsis, ParamSpec, or Concatenate. Got ~P

======================================================================
ERROR: test_pickle (test.test_typing.CollectionsCallableTests.test_pickle)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2236, in test_pickle
    Callable[P_pickle, int],
    ~~~~~~~~^^^^^^^^^^^^^^^
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/_collections_abc.py", line 477, in __new__
    raise TypeError(f"Expected a list of types, an ellipsis, "
TypeError: Expected a list of types, an ellipsis, ParamSpec, or Concatenate. Got ~P_pickle

======================================================================
ERROR: test_immutability_by_copy_and_pickle (test.test_typing.GenericTests.test_immutability_by_copy_and_pickle) (thing=~TP)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4864, in test_immutability_by_copy_and_pickle
    self.assertIs(pickle.loads(pickle.dumps(X, proto)), X)
                                      ^^^^^
_pickle.PicklingError: Can't pickle ~TP: it's not found as _pypy_typing.TP

======================================================================
ERROR: test_immutability_by_copy_and_pickle (test.test_typing.GenericTests.test_immutability_by_copy_and_pickle) (thing=~TPB)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4864, in test_immutability_by_copy_and_pickle
    self.assertIs(pickle.loads(pickle.dumps(X, proto)), X)
                                      ^^^^^
_pickle.PicklingError: Can't pickle ~TPB: it's not found as _pypy_typing.TPB

======================================================================
ERROR: test_immutability_by_copy_and_pickle (test.test_typing.GenericTests.test_immutability_by_copy_and_pickle) (thing=~TPV)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4864, in test_immutability_by_copy_and_pickle
    self.assertIs(pickle.loads(pickle.dumps(X, proto)), X)
                                      ^^^^^
_pickle.PicklingError: Can't pickle ~TPV: it's not found as _pypy_typing.TPV

======================================================================
ERROR: test_immutability_by_copy_and_pickle (test.test_typing.GenericTests.test_immutability_by_copy_and_pickle) (thing=~PP)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4864, in test_immutability_by_copy_and_pickle
    self.assertIs(pickle.loads(pickle.dumps(X, proto)), X)
                                      ^^^^^
_pickle.PicklingError: Can't pickle ~PP: it's not found as _pypy_typing.PP

======================================================================
ERROR: test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.args, proto=0)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4831, in test_pickle
    pickle.loads(pickle.dumps(thing, proto)),
                        ^^^^^
_pickle.PicklingError: Can't pickle ~PP: it's not found as _pypy_typing.PP

======================================================================
ERROR: test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.args, proto=1)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4831, in test_pickle
    pickle.loads(pickle.dumps(thing, proto)),
                        ^^^^^
_pickle.PicklingError: Can't pickle ~PP: it's not found as _pypy_typing.PP

======================================================================
ERROR: test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.args, proto=2)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4831, in test_pickle
    pickle.loads(pickle.dumps(thing, proto)),
                        ^^^^^
_pickle.PicklingError: Can't pickle ~PP: it's not found as _pypy_typing.PP

======================================================================
ERROR: test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.args, proto=3)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4831, in test_pickle
    pickle.loads(pickle.dumps(thing, proto)),
                        ^^^^^
_pickle.PicklingError: Can't pickle ~PP: it's not found as _pypy_typing.PP

======================================================================
ERROR: test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.args, proto=4)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4831, in test_pickle
    pickle.loads(pickle.dumps(thing, proto)),
                        ^^^^^
_pickle.PicklingError: Can't pickle ~PP: it's not found as _pypy_typing.PP

======================================================================
ERROR: test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.args, proto=5)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4831, in test_pickle
    pickle.loads(pickle.dumps(thing, proto)),
                        ^^^^^
_pickle.PicklingError: Can't pickle ~PP: it's not found as _pypy_typing.PP

======================================================================
ERROR: test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.kwargs, proto=0)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4831, in test_pickle
    pickle.loads(pickle.dumps(thing, proto)),
                        ^^^^^
_pickle.PicklingError: Can't pickle ~PP: it's not found as _pypy_typing.PP

======================================================================
ERROR: test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.kwargs, proto=1)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4831, in test_pickle
    pickle.loads(pickle.dumps(thing, proto)),
                        ^^^^^
_pickle.PicklingError: Can't pickle ~PP: it's not found as _pypy_typing.PP

======================================================================
ERROR: test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.kwargs, proto=2)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4831, in test_pickle
    pickle.loads(pickle.dumps(thing, proto)),
                        ^^^^^
_pickle.PicklingError: Can't pickle ~PP: it's not found as _pypy_typing.PP

======================================================================
ERROR: test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.kwargs, proto=3)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4831, in test_pickle
    pickle.loads(pickle.dumps(thing, proto)),
                        ^^^^^
_pickle.PicklingError: Can't pickle ~PP: it's not found as _pypy_typing.PP

======================================================================
ERROR: test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.kwargs, proto=4)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4831, in test_pickle
    pickle.loads(pickle.dumps(thing, proto)),
                        ^^^^^
_pickle.PicklingError: Can't pickle ~PP: it's not found as _pypy_typing.PP

======================================================================
ERROR: test_pickle (test.test_typing.GenericTests.test_pickle) (thing=PP.kwargs, proto=5)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4831, in test_pickle
    pickle.loads(pickle.dumps(thing, proto)),
                        ^^^^^
_pickle.PicklingError: Can't pickle ~PP: it's not found as _pypy_typing.PP

======================================================================
ERROR: test_get_type_hints_collections_abc_callable (test.test_typing.GetTypeHintTests.test_get_type_hints_collections_abc_callable)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 6670, in test_get_type_hints_collections_abc_callable
    def h(x: collections.abc.Callable[P, int]): ...
             ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/_collections_abc.py", line 477, in __new__
    raise TypeError(f"Expected a list of types, an ellipsis, "
TypeError: Expected a list of types, an ellipsis, ParamSpec, or Concatenate. Got ~P

======================================================================
ERROR: test_get_args (test.test_typing.GetUtilitiesTestCase.test_get_args)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 6756, in test_get_args
    self.assertEqual(get_args(collections.abc.Callable[P, int]), (P, int))
                              ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/_collections_abc.py", line 477, in __new__
    raise TypeError(f"Expected a list of types, an ellipsis, "
TypeError: Expected a list of types, an ellipsis, ParamSpec, or Concatenate. Got ~P

======================================================================
ERROR: test_typevartuple_and_paramspecs_in_generic_aliases (test.test_typing.ParamSpecTests.test_typevartuple_and_paramspecs_in_generic_aliases) (generic=<class 'collections.abc.Callable'>)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 9059, in test_typevartuple_and_paramspecs_in_generic_aliases
    A = C[P, Tuple[*Ts]]
        ~^^^^^^^^^^^^^^^
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/_collections_abc.py", line 477, in __new__
    raise TypeError(f"Expected a list of types, an ellipsis, "
TypeError: Expected a list of types, an ellipsis, ParamSpec, or Concatenate. Got ~P

======================================================================
ERROR: test_valid_uses (test.test_typing.ParamSpecTests.test_valid_uses)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 8912, in test_valid_uses
    C3 = collections.abc.Callable[P, int]
         ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/_collections_abc.py", line 477, in __new__
    raise TypeError(f"Expected a list of types, an ellipsis, "
TypeError: Expected a list of types, an ellipsis, ParamSpec, or Concatenate. Got ~P

======================================================================
ERROR: test_special_attrs (test.test_typing.SpecialAttrsTests.test_special_attrs) (cls=typing.Concatenate[typing.Any, ~SpecialAttrsP])
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 9523, in test_special_attrs
    s = pickle.dumps(cls, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~SpecialAttrsP: it's not found as _pypy_typing.SpecialAttrsP

======================================================================
ERROR: test_pickling_then_unpickling_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_results_in_same_identity) (pickle_proto=0)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1754, in test_pickling_then_unpickling_results_in_same_identity
    global_Ts2 = pickle.loads(pickle.dumps(global_Ts1, proto))
                                     ^^^^^
_pickle.PicklingError: Can't pickle global_Ts1: it's not found as _pypy_typing.global_Ts1

======================================================================
ERROR: test_pickling_then_unpickling_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_results_in_same_identity) (pickle_proto=1)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1754, in test_pickling_then_unpickling_results_in_same_identity
    global_Ts2 = pickle.loads(pickle.dumps(global_Ts1, proto))
                                     ^^^^^
_pickle.PicklingError: Can't pickle global_Ts1: it's not found as _pypy_typing.global_Ts1

======================================================================
ERROR: test_pickling_then_unpickling_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_results_in_same_identity) (pickle_proto=2)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1754, in test_pickling_then_unpickling_results_in_same_identity
    global_Ts2 = pickle.loads(pickle.dumps(global_Ts1, proto))
                                     ^^^^^
_pickle.PicklingError: Can't pickle global_Ts1: it's not found as _pypy_typing.global_Ts1

======================================================================
ERROR: test_pickling_then_unpickling_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_results_in_same_identity) (pickle_proto=3)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1754, in test_pickling_then_unpickling_results_in_same_identity
    global_Ts2 = pickle.loads(pickle.dumps(global_Ts1, proto))
                                     ^^^^^
_pickle.PicklingError: Can't pickle global_Ts1: it's not found as _pypy_typing.global_Ts1

======================================================================
ERROR: test_pickling_then_unpickling_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_results_in_same_identity) (pickle_proto=4)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1754, in test_pickling_then_unpickling_results_in_same_identity
    global_Ts2 = pickle.loads(pickle.dumps(global_Ts1, proto))
                                     ^^^^^
_pickle.PicklingError: Can't pickle global_Ts1: it's not found as _pypy_typing.global_Ts1

======================================================================
ERROR: test_pickling_then_unpickling_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_results_in_same_identity) (pickle_proto=5)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1754, in test_pickling_then_unpickling_results_in_same_identity
    global_Ts2 = pickle.loads(pickle.dumps(global_Ts1, proto))
                                     ^^^^^
_pickle.PicklingError: Can't pickle global_Ts1: it's not found as _pypy_typing.global_Ts1

======================================================================
ERROR: test_pickling_then_unpickling_tuple_with_typevartuple_equality (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_tuple_with_typevartuple_equality) (pickle_proto=0)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1789, in test_pickling_then_unpickling_tuple_with_typevartuple_equality
    t2 = pickle.loads(pickle.dumps(t, proto))
                             ^^^^^
_pickle.PicklingError: Can't pickle global_Ts: it's not found as _pypy_typing.global_Ts

======================================================================
ERROR: test_pickling_then_unpickling_tuple_with_typevartuple_equality (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_tuple_with_typevartuple_equality) (pickle_proto=1)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1789, in test_pickling_then_unpickling_tuple_with_typevartuple_equality
    t2 = pickle.loads(pickle.dumps(t, proto))
                             ^^^^^
_pickle.PicklingError: Can't pickle global_Ts: it's not found as _pypy_typing.global_Ts

======================================================================
ERROR: test_pickling_then_unpickling_tuple_with_typevartuple_equality (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_tuple_with_typevartuple_equality) (pickle_proto=2)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1789, in test_pickling_then_unpickling_tuple_with_typevartuple_equality
    t2 = pickle.loads(pickle.dumps(t, proto))
                             ^^^^^
_pickle.PicklingError: Can't pickle global_Ts: it's not found as _pypy_typing.global_Ts

======================================================================
ERROR: test_pickling_then_unpickling_tuple_with_typevartuple_equality (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_tuple_with_typevartuple_equality) (pickle_proto=3)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1789, in test_pickling_then_unpickling_tuple_with_typevartuple_equality
    t2 = pickle.loads(pickle.dumps(t, proto))
                             ^^^^^
_pickle.PicklingError: Can't pickle global_Ts: it's not found as _pypy_typing.global_Ts

======================================================================
ERROR: test_pickling_then_unpickling_tuple_with_typevartuple_equality (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_tuple_with_typevartuple_equality) (pickle_proto=4)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1789, in test_pickling_then_unpickling_tuple_with_typevartuple_equality
    t2 = pickle.loads(pickle.dumps(t, proto))
                             ^^^^^
_pickle.PicklingError: Can't pickle global_Ts: it's not found as _pypy_typing.global_Ts

======================================================================
ERROR: test_pickling_then_unpickling_tuple_with_typevartuple_equality (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_tuple_with_typevartuple_equality) (pickle_proto=5)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1789, in test_pickling_then_unpickling_tuple_with_typevartuple_equality
    t2 = pickle.loads(pickle.dumps(t, proto))
                             ^^^^^
_pickle.PicklingError: Can't pickle global_Ts: it's not found as _pypy_typing.global_Ts

======================================================================
ERROR: test_pickling_then_unpickling_unpacked_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_unpacked_results_in_same_identity) (pickle_proto=0)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1763, in test_pickling_then_unpickling_unpacked_results_in_same_identity
    unpacked2 = pickle.loads(pickle.dumps(unpacked1, proto))
                                    ^^^^^
_pickle.PicklingError: Can't pickle global_Ts: it's not found as _pypy_typing.global_Ts

======================================================================
ERROR: test_pickling_then_unpickling_unpacked_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_unpacked_results_in_same_identity) (pickle_proto=1)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1763, in test_pickling_then_unpickling_unpacked_results_in_same_identity
    unpacked2 = pickle.loads(pickle.dumps(unpacked1, proto))
                                    ^^^^^
_pickle.PicklingError: Can't pickle global_Ts: it's not found as _pypy_typing.global_Ts

======================================================================
ERROR: test_pickling_then_unpickling_unpacked_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_unpacked_results_in_same_identity) (pickle_proto=2)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1763, in test_pickling_then_unpickling_unpacked_results_in_same_identity
    unpacked2 = pickle.loads(pickle.dumps(unpacked1, proto))
                                    ^^^^^
_pickle.PicklingError: Can't pickle global_Ts: it's not found as _pypy_typing.global_Ts

======================================================================
ERROR: test_pickling_then_unpickling_unpacked_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_unpacked_results_in_same_identity) (pickle_proto=3)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1763, in test_pickling_then_unpickling_unpacked_results_in_same_identity
    unpacked2 = pickle.loads(pickle.dumps(unpacked1, proto))
                                    ^^^^^
_pickle.PicklingError: Can't pickle global_Ts: it's not found as _pypy_typing.global_Ts

======================================================================
ERROR: test_pickling_then_unpickling_unpacked_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_unpacked_results_in_same_identity) (pickle_proto=4)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1763, in test_pickling_then_unpickling_unpacked_results_in_same_identity
    unpacked2 = pickle.loads(pickle.dumps(unpacked1, proto))
                                    ^^^^^
_pickle.PicklingError: Can't pickle global_Ts: it's not found as _pypy_typing.global_Ts

======================================================================
ERROR: test_pickling_then_unpickling_unpacked_results_in_same_identity (test.test_typing.TypeVarTuplePicklingTests.test_pickling_then_unpickling_unpacked_results_in_same_identity) (pickle_proto=5)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 73, in wrapper
    test_func(self, proto=proto)
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1763, in test_pickling_then_unpickling_unpacked_results_in_same_identity
    unpacked2 = pickle.loads(pickle.dumps(unpacked1, proto))
                                    ^^^^^
_pickle.PicklingError: Can't pickle global_Ts: it's not found as _pypy_typing.global_Ts

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, int], proto=0)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, int], proto=1)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, int], proto=2)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, int], proto=3)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, int], proto=4)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, int], proto=5)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, ~T_pickle], proto=0)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, ~T_pickle], proto=1)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, ~T_pickle], proto=2)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, ~T_pickle], proto=3)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, ~T_pickle], proto=4)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[~P_pickle, ~T_pickle], proto=5)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[int, ~P_pickle], int], proto=0)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[int, ~P_pickle], int], proto=1)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[int, ~P_pickle], int], proto=2)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[int, ~P_pickle], int], proto=3)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[int, ~P_pickle], int], proto=4)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[int, ~P_pickle], int], proto=5)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle ~P_pickle: it's not found as _pypy_typing.P_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[typing.Unpack[TS_pickle], ~P_pickle], int], proto=0)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle TS_pickle: it's not found as _pypy_typing.TS_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[typing.Unpack[TS_pickle], ~P_pickle], int], proto=1)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle TS_pickle: it's not found as _pypy_typing.TS_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[typing.Unpack[TS_pickle], ~P_pickle], int], proto=2)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle TS_pickle: it's not found as _pypy_typing.TS_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[typing.Unpack[TS_pickle], ~P_pickle], int], proto=3)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle TS_pickle: it's not found as _pypy_typing.TS_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[typing.Unpack[TS_pickle], ~P_pickle], int], proto=4)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle TS_pickle: it's not found as _pypy_typing.TS_pickle

======================================================================
ERROR: test_pickle (test.test_typing.TypingCallableTests.test_pickle) (alias=typing.Callable[typing.Concatenate[typing.Unpack[TS_pickle], ~P_pickle], int], proto=5)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 2244, in test_pickle
    s = pickle.dumps(alias, proto)
               ^^^^^
_pickle.PicklingError: Can't pickle TS_pickle: it's not found as _pypy_typing.TS_pickle

======================================================================
FAIL: test_new_repr_bare (test.test_typing.GenericTests.test_new_repr_bare)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 4326, in test_new_repr_bare
    self.assertEqual(repr(Generic[T]), 'typing.Generic[~T]')
         ^^^^^^^^^^^
AssertionError: '_pypy_typing.Generic[~T]' != 'typing.Generic[~T]'
- _pypy_typing.Generic[~T]
? ------
+ typing.Generic[~T]


======================================================================
FAIL: test_basic_plain (test.test_typing.ParamSpecTests.test_basic_plain)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 8892, in test_basic_plain
    self.assertEqual(P.__module__, __name__)
         ^^^^^^^^^^^
AssertionError: '_pypy_typing' != 'test.test_typing'
- _pypy_typing
+ test.test_typing


======================================================================
FAIL: test_basic_with_exec (test.test_typing.ParamSpecTests.test_basic_with_exec)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 8900, in test_basic_with_exec
    self.assertIs(P.__module__, None)
         ^^^^^^^^
AssertionError: '_pypy_typing' is not None

======================================================================
FAIL: test_cannot_subclass (test.test_typing.ParamSpecTests.test_cannot_subclass)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 9261, in test_cannot_subclass
    with self.assertRaisesRegex(TypeError, NOT_A_BASE_TYPE % 'ParamSpec'):
AssertionError: TypeError not raised

======================================================================
FAIL: test_special_attrs (test.test_typing.SpecialAttrsTests.test_special_attrs) (cls=<class '_pypy_typing.TypeVar'>)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 9521, in test_special_attrs
    self.assertEqual(cls.__module__, 'typing', str(cls))
         ^^^^^^^^^^^
AssertionError: '_pypy_typing' != 'typing'
- _pypy_typing
+ typing
 : <class '_pypy_typing.TypeVar'>

======================================================================
FAIL: test_special_attrs2 (test.test_typing.SpecialAttrsTests.test_special_attrs2)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 9539, in test_special_attrs2
    with self.assertRaises(TypeError):
AssertionError: TypeError not raised

======================================================================
FAIL: test_basic_plain (test.test_typing.TypeVarTests.test_basic_plain)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 388, in test_basic_plain
    self.assertEqual(T.__module__, __name__)
         ^^^^^^^^^^^
AssertionError: '_pypy_typing' != 'test.test_typing'
- _pypy_typing
+ test.test_typing


======================================================================
FAIL: test_basic_with_exec (test.test_typing.TypeVarTests.test_basic_with_exec)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 401, in test_basic_with_exec
    self.assertIs(T.__module__, None)
         ^^^^^^^^
AssertionError: '_pypy_typing' is not None

======================================================================
FAIL: test_cannot_combine_explicit_and_infer (test.test_typing.TypeVarTests.test_cannot_combine_explicit_and_infer)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 523, in test_cannot_combine_explicit_and_infer
    with self.assertRaises(ValueError):
AssertionError: ValueError not raised

======================================================================
FAIL: test_cannot_subclass (test.test_typing.TypeVarTests.test_cannot_subclass)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 491, in test_cannot_subclass
    with self.assertRaisesRegex(TypeError, NOT_A_BASE_TYPE % 'TypeVar'):
AssertionError: TypeError not raised

======================================================================
FAIL: test_bad_var_substitution (test.test_typing.TypeVarTupleTests.test_bad_var_substitution)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1186, in test_bad_var_substitution
    with self.assertRaises(TypeError):
AssertionError: TypeError not raised

======================================================================
FAIL: test_cannot_subclass (test.test_typing.TypeVarTupleTests.test_cannot_subclass)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1321, in test_cannot_subclass
    with self.assertRaisesRegex(TypeError, NOT_A_BASE_TYPE % 'TypeVarTuple'):
AssertionError: TypeError not raised

======================================================================
FAIL: test_exec (test.test_typing.TypeVarTupleTests.test_exec)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1056, in test_exec
    self.assertIs(Ts.__module__, None)
         ^^^^^^^^
AssertionError: '_pypy_typing' is not None

======================================================================
FAIL: test_module (test.test_typing.TypeVarTupleTests.test_module)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1049, in test_module
    self.assertEqual(Ts.__module__, __name__)
         ^^^^^^^^^^^
AssertionError: '_pypy_typing' != 'test.test_typing'
- _pypy_typing
+ test.test_typing


======================================================================
FAIL: test_variadic_class_definition_using_packed_typevartuple_fails (test.test_typing.TypeVarTupleTests.test_variadic_class_definition_using_packed_typevartuple_fails)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/test/test_typing.py", line 1551, in test_variadic_class_definition_using_packed_typevartuple_fails
    with self.assertRaises(TypeError):
AssertionError: TypeError not raised

======================================================================
FAIL: _should_unflatten_callable_args (typing)
Doctest: typing._should_unflatten_callable_args
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/doctest.py", line 2256, in runTest
    raise self.failureException(self.format_failure(new.getvalue()))
AssertionError: Failed doctest test for typing._should_unflatten_callable_args
  File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/typing.py", line 213, in _should_unflatten_callable_args

----------------------------------------------------------------------
File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/typing.py", line 225, in typing._should_unflatten_callable_args
Failed example:
    collections.abc.Callable[P, str].__args__ == (P, str)
Exception raised:
    Traceback (most recent call last):
      File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/doctest.py", line 1368, in __run
        exec(compile(example.source, filename, "single",
      File "<doctest typing._should_unflatten_callable_args[3]>", line 1, in <module>
        collections.abc.Callable[P, str].__args__ == (P, str)
        ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
      File "/Users/matti/build-worker-arm64/pypy-c-jit-macos-arm64/build/lib-python/3/_collections_abc.py", line 477, in __new__
        raise TypeError(f"Expected a list of types, an ellipsis, "
    TypeError: Expected a list of types, an ellipsis, ParamSpec, or Concatenate. Got ~P


----------------------------------------------------------------------
Ran 633 tests in 0.336s

FAILED (failures=16, errors=67, skipped=2)
0:00:00 load avg: 2.36 [1/1/1] test_typing failed (67 errors, 16 failures)

== Tests result: FAILURE ==

1 test failed:
    test_typing

Total duration: 527 ms
Total tests: run=633 failures=16 skipped=2
Total test files: run=1/1 failed=1
Result: FAILURE
test test_typing failed

builder: pypy-c-jit-macos-arm64 build #1306+

test: lib-python/3/test/test_typing.py::unmodified