Microsoft Windows [Version 10.0.19041.867] (c) 2020 Microsoft Corporation. Tüm hakları saklıdır. C:\Users\canat>conda activate tf15 (tf15) C:\Users\canat>d: (tf15) D:\>D:\ProgramData\Anaconda3\envs\tf15\python.exe D:/object/my_custom_detector/model_main.py --model_dir=D:/object/my_custom_detector/training --pipeline_config_path=D:/object/my_custom_detector/training/ssd_mobilenet_v1_coco.config --num_train_steps=40000 2021-04-07 16:25:01.393848: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'cudart64_100.dll'; dlerror: cudart64_100.dll not found 2021-04-07 16:25:01.393963: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine. WARNING:tensorflow:From D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\nets\inception_resnet_v2.py:374: The name tf.GraphKeys is deprecated. Please use tf.compat.v1.GraphKeys instead. [04/07 16:25:07] tensorflow WARNING: From D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\nets\inception_resnet_v2.py:374: The name tf.GraphKeys is deprecated. Please use tf.compat.v1.GraphKeys instead. WARNING:tensorflow:From D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\nets\mobilenet\mobilenet.py:397: The name tf.nn.avg_pool is deprecated. Please use tf.nn.avg_pool2d instead. [04/07 16:25:07] tensorflow WARNING: From D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\nets\mobilenet\mobilenet.py:397: The name tf.nn.avg_pool is deprecated. Please use tf.nn.avg_pool2d instead. WARNING:tensorflow:From D:/object/my_custom_detector/model_main.py:109: The name tf.app.run is deprecated. Please use tf.compat.v1.app.run instead. [04/07 16:25:07] tensorflow WARNING: From D:/object/my_custom_detector/model_main.py:109: The name tf.app.run is deprecated. Please use tf.compat.v1.app.run instead. WARNING:tensorflow:Forced number of epochs for all eval validations to be 1. W0407 16:25:07.332338 4168 model_lib.py:813] Forced number of epochs for all eval validations to be 1. INFO:tensorflow:Maybe overwriting train_steps: 40000 I0407 16:25:07.334294 4168 config_util.py:552] Maybe overwriting train_steps: 40000 INFO:tensorflow:Maybe overwriting use_bfloat16: False I0407 16:25:07.335330 4168 config_util.py:552] Maybe overwriting use_bfloat16: False INFO:tensorflow:Maybe overwriting sample_1_of_n_eval_examples: 1 I0407 16:25:07.336290 4168 config_util.py:552] Maybe overwriting sample_1_of_n_eval_examples: 1 INFO:tensorflow:Maybe overwriting eval_num_epochs: 1 I0407 16:25:07.337301 4168 config_util.py:552] Maybe overwriting eval_num_epochs: 1 INFO:tensorflow:Maybe overwriting load_pretrained: True I0407 16:25:07.338284 4168 config_util.py:552] Maybe overwriting load_pretrained: True INFO:tensorflow:Ignoring config override key: load_pretrained I0407 16:25:07.339287 4168 config_util.py:562] Ignoring config override key: load_pretrained WARNING:tensorflow:Expected number of evaluation epochs is 1, but instead encountered `eval_on_train_input_config.num_epochs` = 0. Overwriting `num_epochs` to 1. W0407 16:25:07.341276 4168 model_lib.py:829] Expected number of evaluation epochs is 1, but instead encountered `eval_on_train_input_config.num_epochs` = 0. Overwriting `num_epochs` to 1. INFO:tensorflow:create_estimator_and_inputs: use_tpu False, export_to_tpu False I0407 16:25:07.342273 4168 model_lib.py:866] create_estimator_and_inputs: use_tpu False, export_to_tpu False INFO:tensorflow:Using config: {'_model_dir': 'D:/object/my_custom_detector/training', '_tf_random_seed': None, '_save_summary_steps': 100, '_save_checkpoints_steps': None, '_save_checkpoints_secs': 600, '_session_config': allow_soft_placement: true graph_options { rewrite_options { meta_optimizer_iterations: ONE } } , '_keep_checkpoint_max': 5, '_keep_checkpoint_every_n_hours': 10000, '_log_step_count_steps': 100, '_train_distribute': None, '_device_fn': None, '_protocol': None, '_eval_distribute': None, '_experimental_distribute': None, '_experimental_max_worker_delay_secs': None, '_session_creation_timeout_secs': 7200, '_service': None, '_cluster_spec': , '_task_type': 'worker', '_task_id': 0, '_global_id_in_cluster': 0, '_master': '', '_evaluation_master': '', '_is_chief': True, '_num_ps_replicas': 0, '_num_worker_replicas': 1} I0407 16:25:07.365902 4168 estimator.py:212] Using config: {'_model_dir': 'D:/object/my_custom_detector/training', '_tf_random_seed': None, '_save_summary_steps': 100, '_save_checkpoints_steps': None, '_save_checkpoints_secs': 600, '_session_config': allow_soft_placement: true graph_options { rewrite_options { meta_optimizer_iterations: ONE } } , '_keep_checkpoint_max': 5, '_keep_checkpoint_every_n_hours': 10000, '_log_step_count_steps': 100, '_train_distribute': None, '_device_fn': None, '_protocol': None, '_eval_distribute': None, '_experimental_distribute': None, '_experimental_max_worker_delay_secs': None, '_session_creation_timeout_secs': 7200, '_service': None, '_cluster_spec': , '_task_type': 'worker', '_task_id': 0, '_global_id_in_cluster': 0, '_master': '', '_evaluation_master': '', '_is_chief': True, '_num_ps_replicas': 0, '_num_worker_replicas': 1} WARNING:tensorflow:Estimator's model_fn (.model_fn at 0x000002931BC4B798>) includes params argument, but params are not passed to Estimator. W0407 16:25:07.369593 4168 model_fn.py:630] Estimator's model_fn (.model_fn at 0x000002931BC4B798>) includes params argument, but params are not passed to Estimator. INFO:tensorflow:Not using Distribute Coordinator. I0407 16:25:07.370610 4168 estimator_training.py:186] Not using Distribute Coordinator. INFO:tensorflow:Running training and evaluation locally (non-distributed). I0407 16:25:07.371607 4168 training.py:612] Running training and evaluation locally (non-distributed). INFO:tensorflow:Start train and evaluate loop. The evaluate will happen after every checkpoint. Checkpoint frequency is determined based on RunConfig arguments: save_checkpoints_steps None or save_checkpoints_secs 600. I0407 16:25:07.373567 4168 training.py:700] Start train and evaluate loop. The evaluate will happen after every checkpoint. Checkpoint frequency is determined based on RunConfig arguments: save_checkpoints_steps None or save_checkpoints_secs 600. WARNING:tensorflow:From D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\tensorflow_core\python\training\training_util.py:236: Variable.initialized_value (from tensorflow.python.ops.variables) is deprecated and will be removed in a future version. Instructions for updating: Use Variable.read_value. Variables in 2.X are initialized automatically both in eager and graph (inside tf.defun) contexts. W0407 16:25:07.897971 4168 deprecation.py:323] From D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\tensorflow_core\python\training\training_util.py:236: Variable.initialized_value (from tensorflow.python.ops.variables) is deprecated and will be removed in a future version. Instructions for updating: Use Variable.read_value. Variables in 2.X are initialized automatically both in eager and graph (inside tf.defun) contexts. Windows fatal exception: access violation Current thread 0x00001048 (most recent call first): File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\tensorflow_core\python\lib\io\file_io.py", line 84 in _preread_check File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\tensorflow_core\python\lib\io\file_io.py", line 122 in read File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\object_detection\utils\label_map_util.py", line 168 in load_labelmap File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\object_detection\utils\label_map_util.py", line 201 in get_label_map_dict File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\object_detection\data_decoders\tf_example_decoder.py", line 89 in __init__ File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\object_detection\data_decoders\tf_example_decoder.py", line 416 in __init__ File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\object_detection\builders\decoder_builder.py", line 64 in build File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\object_detection\builders\dataset_builder.py", line 210 in build File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\object_detection\inputs.py", line 898 in train_input File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\object_detection\inputs.py", line 758 in _train_input_fn File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\tensorflow_estimator\python\estimator\estimator.py", line 1116 in _call_input_fn File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\tensorflow_estimator\python\estimator\estimator.py", line 1025 in _get_features_and_labels_from_input_fn File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\tensorflow_estimator\python\estimator\estimator.py", line 1188 in _train_model_default File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\tensorflow_estimator\python\estimator\estimator.py", line 1161 in _train_model File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\tensorflow_estimator\python\estimator\estimator.py", line 370 in train File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\tensorflow_estimator\python\estimator\training.py", line 714 in run_local File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\tensorflow_estimator\python\estimator\training.py", line 613 in run File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\tensorflow_estimator\python\estimator\training.py", line 473 in train_and_evaluate File "D:/object/my_custom_detector/model_main.py", line 105 in main File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\absl\app.py", line 251 in _run_main File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\absl\app.py", line 303 in run File "D:\ProgramData\Anaconda3\envs\tf15\lib\site-packages\tensorflow_core\python\platform\app.py", line 40 in run File "D:/object/my_custom_detector/model_main.py", line 109 in (tf15) D:\>