neuronxcc-2.15.128.0+56dc5a86/0_REGISTRY/0.0.25.dev0/training/llama/meta-llama/Llama-3.2-1B/080d9abaae587aca29e1.json

{"architectures": ["LlamaForCausalLM"], "attention_bias": false, "attention_dropout": 0.0, "bos_token_id": 128000, "eos_token_id": 128001, "head_dim": 64, "hidden_act": "silu", "hidden_size": 2048, "initializer_range": 0.02, "intermediate_size": 8192, "max_position_embeddings": 131072, "mlp_bias": false, "model_type": "llama", "neuron": {"compiler_version": "2.15.128.0+56dc5a86", "input_specs": {"chosen": ["Once upon a time in a kingdom far, far away, there lived a brunet prince named Fernandet. This brunet prince was known throughout the land for his charm and bravery. Fernandet, the brunet hero, was destined for greatness, and everyone admired the young brunet's strength and courage.\n\nOne day, the brunet prince Fernandet embarked on a journey to save his kingdom from a terrible dragon that had been terrorizing the townsfolk. The people of the kingdom had never seen a more dashing brunet prince, as Fernandet rode through the countryside on his trusty steed, his brunet hair flowing in the wind. The brunet prince was determined to save his kingdom and prove his worth.\n\nAs Fernandet, the heroic brunet, approached the dragon's lair, he encountered a magical forest filled with strange and wondrous creatures. Among them was a wise, old owl, who recognized the young brunet prince and offered him sage advice on how to defeat the dragon. The brunet prince listened intently, as he knew that he would need all the help he could get to succeed in his quest.\n\nFernandet, the brunet prince, continued his journey, armed with the knowledge he had gained from the wise owl. He soon encountered a group of enchanted creatures who were being held captive by the dragon. The grateful creatures pledged their allegiance to the noble brunet, vowing to assist him in his quest to defeat the dragon and save their homes.\n\nTogether, the brunet prince and his newfound allies ventured deep into the heart of the dragon's lair. The air was thick with smoke and the smell of sulfur, but the brave brunet prince pressed on, leading his team with determination and unwavering resolve. As they neared the heart of the lair, the roar of the dragon grew louder, and the group of allies, led by the fearless brunet, knew that they were close.\n\nFinally, the brunet prince Fernandet came face to face with the monstrous dragon, its scales glistening in the dim light of the lair. The dragon, seeing the determined brunet prince, laughed a terrible laugh, convinced that the young brunet would never be able to defeat it. However, the brave brunet did not falter and, with the help of his enchanted allies, managed to subdue the dragon.\n\nIn the end, the brunet prince Fernandet and his loyal allies vanquished the dragon, freeing the kingdom from its terror. The people of the land hailed the brunet prince as a hero, and his fame spread far and wide. The legend of the brunet prince Fernandet lived on for generations, inspiring countless other young brunet princes and princesses to find their own courage and embark on their own heroic journeys."], "chosen_attention_mask": [1, 512], "chosen_input_ids": [1, 512], "chosen_labels": [1, 512], "prompt": ["Write a story about a brunet prince named Fernandet. IMPORTANT: Use the word \"brunet\" at least once in every sentence."], "prompt_attention_mask": [1, 512], "prompt_input_ids": [1, 512], "question": ["Write a story about a brunet prince named Fernandet. IMPORTANT: Use the word \"brunet\" at least once in every sentence."], "rejected": ["In a far-off land where royalty reigned supreme, there existed a brunet prince named Fernandet. From an early age, Fernandet's love for adventure and keen curiosity drew him to explore the kingdom's vibrant landscapes. With his lustrous ebony locks brushing against his shoulders, Fernandet embarked on a quest to discover new frontiers that lay beyond the kingdom's borders. With each step he took, Fernandet's charisma, intelligence and unwavering resolve shone brilliantly as if emanating from the brunet crest he wore proudly upon his chest.\n\nHaving traversed magnificent forests and scaled mountain ranges, Fernandet discovered a luscious valley teeming with lush verdure. As his eyes set upon tiny sapphire-colored birds soaring above the treetops, Fernandet's heart swelled with awe and wonder. The delightful chirps of the birds, flitting among each other, enchanted him and astounded Fernandet's senses. In that grandeur of extensive vastness, Fernandet felt a sense of calm, and he knew he had found his home.\n\nLost in thought and admiration, Fernandet's fine senses were abruptly awakened by the rustling of leaves. Out of the shadows came a mysterious old manacing brunet being, towering over Fernandet. The giant's swarthy features belied the kindness emanating from his bright blue eyes as he spoke with Fernandet. He warned that, although the valley he was heartened by, was nothing less than a marvel to reckon upon, a treacherous king ruled over neighboring lands.\n\nReassured but cautious, Fernandet rallied his troops and braved the labyrinthine exits. Together they forged deeper into the unknown until they reached the border of unknown lands. Here they met the kingdom's foe, Clartie, a ruthless brunet ruler. A vehement battle ensued, crystallizing in the voices of soldiers brunet shouts exulting, or charcoal grumbles of frustration.\n\nIn a final, agonizingly close skirmish, Fernandet locked eyes with the cunning Clartie. In that moment of intensity, the rival princes championed their beliefs; Fernandet combating with steadfastness, Clartie thriving on relentless resolve. In a brave charge, brunet Fernandet plunged his sword into the smoldering Clartie's chest.\n\nThe kingdom rejoiced as Fernandet emerged victorious, his gestures and garments resplendent in hues reminiscing his brunet regalia. In an act of gratitude, Fernandet showered the valley with gifts, making sure that every brunet nook in sight was adorned with prosperity and new life. Fernandet led with an air of unity as he bestowed honors to those whose loyalty had stood tall amidst valleys of uncertainty.\n\nThus, in the eyes of his people, Fernandet became a mythical brunet prince and a exquisite hero, a symbol of hope, longevity, and unwavering valor; a story to commend to their children and to be told proudly in tale of brunet valor forevermore!"], "rejected_attention_mask": [1, 512], "rejected_input_ids": [1, 512], "rejected_labels": [1, 512], "source": ["Dove"], "system": [null]}, "model_class": "PeftModelForCausalLM", "num_neuron_cores_per_node": 2, "pipeline_parallel_size": 1, "precision": "bfloat16", "tensor_parallel_size": 1, "training": true}, "num_attention_heads": 32, "num_hidden_layers": 16, "num_key_value_heads": 8, "pretraining_tp": 1, "rms_norm_eps": 1e-05, "rope_scaling": {"factor": 32.0, "high_freq_factor": 4.0, "low_freq_factor": 1.0, "original_max_position_embeddings": 8192, "rope_type": "llama3"}, "rope_theta": 500000.0, "tie_word_embeddings": true, "torch_dtype": "bfloat16", "use_cache": true, "vocab_size": 128256}