Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Please share the name of "post_layernorm" OwlPredictor.encode_image_torch for output-blob-names for deepstream configuration #7

Open
pakyurekm opened this issue Nov 18, 2023 · 0 comments

Comments

@pakyurekm
Copy link

pakyurekm commented Nov 18, 2023

in OwlPredictor.encode_image_torch

def encode_image_torch(self, image: torch.Tensor)
        vision_outputs = self.model.owlvit.vision_model(image)
        last_hidden_state = vision_outputs[0]
        image_embeds = self.model.owlvit.vision_model.post_layernorm(last_hidden_state)
        class_token_out = image_embeds[:, :1, :]
        image_embeds = image_embeds[:, 1:, :] * class_token_out
        image_embeds = self.model.layer_norm(image_embeds) 

Please share the name of post_layernorm to address output-blob-names in deepstream configuration file
this is my config file

property]
gpu-id=0
model-engine-file=/nanoowl_utils/data/owl_image_encoder_patch32.engine
process-mode=2
network-mode=2
net-scale-factor=0.0146
offsets=122.77;116.75;104.094
secondary-reinfer-interval=0
gie-unique-id=2
output-blob-names=LayerNorm
output-tensor-meta=1
network-type=1
operate-on-gie-id=1
operate-on-class-ids=2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant