#archived-dots

zinc plinth Oct 25, 2020, 11:23 AM

#

@shy pilot you can't have dynamic buffers in components

#

also it feels like your data is way too much conglomerated

#

state, (pregnant & gestationFinish), gender, attacker should be in their own components

deft stump Oct 25, 2020, 12:46 PM

#

Hi. Trying to check one entity component values against several entity components. I'm thinking do an entity query for one and a .foreach for the others when component value changed.
@brazen storm that's a sound idea. I

brazen storm Oct 25, 2020, 1:05 PM

#

thanks @deft stump let's hope it works! Any ideas on sending component value to UI?

slim nebula Oct 25, 2020, 2:41 PM

#

is it possible to somehow load multiple instances of the same subscene in different locations?

hollow sorrel Oct 25, 2020, 3:12 PM

#

a subscene doesn't have a location but yea you should be able to load it multiple times and shift entities inside it by an offset

brazen storm Oct 25, 2020, 3:16 PM

#

can you pass a query into a .ForEach?

slim nebula Oct 25, 2020, 3:16 PM

#

ok thanks

deft stump Oct 25, 2020, 3:34 PM

#

can you pass a query into a .ForEach?
@brazen storm you can.

olive kite Oct 25, 2020, 3:58 PM

#

Some of the Unity samples might be good to look over to get an idea of how they mean for the data to be organized and accessed. For example, a simple guard:

#

`// An IBufferElementData becomes a DynamicBuffer<T>
// This will reserve 8 WaypointPositions of memory per-entity in the chunk
[InternalBufferCapacity(8)]
public struct WaypointPosition : IBufferElementData
{
public float3 Value;
}

// The total time (in seconds) to wait during each idle state
public struct CooldownTime : IComponentData
{
public float Value;
}

// The index of the next waypoint to travel to in our DynamicBuffer<WaypointPosition>
public struct NextWaypointIndex : IComponentData
{
public int Value;
}

// A tag that helps us tell the difference between "Patrolling" and "Chasing"
public struct IsChasingTag : IComponentData
{}

// The position the guard plans to move towards during "Patrolling" and "Chasing"
public struct TargetPosition : IComponentData
{
public float3 Value;
}

// Used to store how long (in seconds) we have been in the idle state. Only exists when "Idle"
public struct IdleTimer : IComponentData
{
public float Value;
}

// Defines a 2D cone in front of the guard, used to detect players
public struct VisionCone : IComponentData
{
public float AngleRadians;
public float ViewDistanceSq;
}

// A tag that helps us tell the difference between "Patrolling" and "Chasing"
public struct IsInTransitionTag : IComponentData
{}
public struct SetNewPath : IComponentData
{
public float3 pathTarget;
}`

slim nebula Oct 25, 2020, 4:02 PM

#

How do I store a subscene on a component? Classes don't appear to be allowed. Do I need to write a custom authoring component to get only the GUID?

slim nebula Oct 25, 2020, 5:00 PM

#

I found this scene reference thing, but it doesn't seem to show up in the editor

#

📎 unknown.png

#

any ideas how to get this working?

#

📎 unknown.png

#

it's just like 0 fucks given

coarse turtle Oct 25, 2020, 5:07 PM

#

SceneReference isn't serializable so it won't show up in the editor. But it looks like it stores a guid so you could probably just expose some sort of text field or numerical field in an authoring component to display the guid

slim nebula Oct 25, 2020, 5:10 PM

#

so like... if you have an entity on a IComponentData, and use GenerateAuthoringComponent, it will create an authoring component with a GameObject property you can populate in the inspector.

#

Is there no way to do this with subscene automatically? I'm I stuck writing a custom authoring component (SubScene on the monobehavior, then copy the GUID to the IComponentData)?

#

I guess it just seems kinda verbose. Was wondering if there was a less verbose way

coarse turtle Oct 25, 2020, 5:12 PM

#

I don't know of any other less verbose way. I also don't tend to use the GenerateAuthoringComponent attribute and just stick with writing IConvertGameObjectToEntity.

slim nebula Oct 25, 2020, 5:12 PM

#

ah ok

#

thank you

proper silo Oct 25, 2020, 5:31 PM

#

Hello! Is NativeQueue not compatible with the burst compiler? I get an error when trying to use one

deft stump Oct 25, 2020, 5:33 PM

#

What does the error say?

proper silo Oct 25, 2020, 5:33 PM

#

"Burst error BC1042: The managed class type Unity.Collections.NativeQueueBlockPoolData* is not supported. Loading from a non-readonly static field Unity.Collections.NativeQueueBlockPool.pData is not supported"

zenith wyvern Oct 25, 2020, 5:38 PM

#

NativeQueue is burst compatible. Can you show the code that's causing the error?

proper silo Oct 25, 2020, 5:46 PM

#

Yes sorry, here is the system @zenith wyvern

    protected override void OnUpdate()
    {
        Entities.ForEach((in DoQueueTestTag tag) => 
        {
            Debug.Log("This is an object");

            NativeQueue<int> queue = new NativeQueue<int>(Allocator.Temp);



            queue.Dispose();
        }).ScheduleParallel();
    }```

zenith wyvern Oct 25, 2020, 5:49 PM

#

You don't need to call dispose on a temp container, it disposes itself. And the [BurstCompile] attribute isn't doing anything in that context, it's only for job structs or static functions used in function pointers

#

Not sure either of those would cause the error though

proper silo Oct 25, 2020, 5:51 PM

#

Removed both and the error still persist unluckily

#

But does that mean that Entities.ForEach are automatically using burst if enabled in the settings ?

stiff skiff Oct 25, 2020, 5:52 PM

#

Yes

#

Entities.ForEach always uses burst until you do Entities.WithoutBurst().ForEach

zenith wyvern Oct 25, 2020, 5:53 PM

#

Just tried this and it runs fine https://hatebin.com/sohuablaei

stiff skiff Oct 25, 2020, 5:53 PM

#

Why are you allocating a queue inside the job?

zenith wyvern Oct 25, 2020, 5:53 PM

#

Not sure what else you're doing to cause the error but it's not from NativeQueue

stiff skiff Oct 25, 2020, 5:53 PM

#

Could be you are both using a different version of the collections or Burst package

proper silo Oct 25, 2020, 5:55 PM

#

I am doing this test in a clean project, to make sure there is nothing else interfering . I am using Collection 0.12.0-preview.13 and burst 1.3.2

#

And I am creating a Queue in the job to deal with some pathfinding algorithm stuff (as an openList)

zenith wyvern Oct 25, 2020, 5:56 PM

#

What version of Unity?

#

Newer version of ECS is only supported in 2020+

proper silo Oct 25, 2020, 5:57 PM

#

yeah, I am using 2020.1.10.f1

slim nebula Oct 25, 2020, 5:57 PM

#

Does anyone know how can I load two separate instances of the same subscene? This seems to only load one set of entities, not two: ```cs
m_sceneSystem.LoadSceneAsync(rooms[0].SceneGUID);
m_sceneSystem.LoadSceneAsync(rooms[0].SceneGUID);

#

@hollow sorrel do you know?

zenith wyvern Oct 25, 2020, 5:59 PM

#

Not sure what's causing the error then. You can see from my code I pasted that NativeQueue works fine on it's own inside a job. Are you sure you're using an unmanaged type in your queue?

proper silo Oct 25, 2020, 6:02 PM

#

Thats odd, it works for you so I am going to check on my side, I must have missed something

stiff skiff Oct 25, 2020, 6:05 PM

#

Hmm

#

https://forum.unity.com/threads/blittable-type-to-nativearray-byte.665755/#post-4459192

Unity Forum

Blittable Type to NativeArray

I'm trying to burst compile / optimize my code as much as possible right now and there's one part where I convert Objects (Blittable types) to a...

#

This post from 2019 says you cant allocate a NativeQueue from inside a burst job though

viral comet Oct 25, 2020, 6:07 PM

#

@blissful gorge

The goal is to have a Burst-compatible delegate that doesn't have the same limitations as FunctionPointer.
Sounds cool, would love to see progress on this

hollow sorrel Oct 25, 2020, 6:07 PM

#

@slim nebula doesn't that method load a unity scene, not a subscene?
by default loading a new scene will unload the current scene

zenith wyvern Oct 25, 2020, 6:08 PM

#

https://forum.unity.com/threads/blittable-type-to-nativearray-byte.665755/#post-4459192
@stiff skiff

You're absolutely right, I had burst compilation disabled in the editor. Sorry about that @proper silo, I was just wrong. Apparently you can't use create a NativeQueue inside a job

slim nebula Oct 25, 2020, 6:08 PM

#

I dont think so no. my old stuff is there. it's only loading in the subscene. What way would you reccomend to load a subscene?

#

@hollow sorrel

hollow sorrel Oct 25, 2020, 6:09 PM

#

not sure, docs are nonexistent on subscenes

slim nebula Oct 25, 2020, 6:09 PM

#

yeah 😦

#

well thanks for tryin

#

i found this: https://forum.unity.com/threads/using-subscenes-like-prefabs.852619/

Unity Forum

Using SubScenes like Prefabs

I've found SubScenes to be really useful. Having a pre-converted, or pure data representation, of objects is awesome, especially to the fact its...

proper silo Oct 25, 2020, 6:09 PM

#

Ohhhh everything makes sense now hahaha Thanks you both of you @zenith wyvern @stiff skiff

slim nebula Oct 25, 2020, 6:09 PM

#

maybe it's not possible

stiff skiff Oct 25, 2020, 6:10 PM

#

@proper silo You can allocate the queue outside the job and capture it

#

I'd always recommend allocating outside of jobs and passing it along somehow

zenith wyvern Oct 25, 2020, 6:10 PM

#

For that purpose it seems like you're better off just using a NativeList though

#

NativeQueue is specifically meant for queueing to the same container from parallel jobs

stiff skiff Oct 25, 2020, 6:10 PM

#

You only have a limited amount of space you can use for temp allocs inside a job, once you go beyond this, stuff gets expensive

hollow sorrel Oct 25, 2020, 6:11 PM

#

@slim nebula if you want a workaround, maybe you could pass in a new LoadParameters as 2nd argument to your loadsceneasync, with loadflags set to additive so that it will add the scene without unloading previous

slim nebula Oct 25, 2020, 6:13 PM

#

📎 unknown.png

#

📎 unknown.png

#

📎 unknown.png

#

didn't seem to change anything. Regardless if I put those load parameters there I still get only one "MuhCube" entity

#

@hollow sorrel

stiff skiff Oct 25, 2020, 6:14 PM

#


Set whether to load additive or not. This only applies to GameObject based scenes, not subscenes.```

hollow sorrel Oct 25, 2020, 6:14 PM

#

hm

#

not sure then sry

slim nebula Oct 25, 2020, 6:15 PM

#

rip

#

well thanks for tryin

stiff skiff Oct 25, 2020, 6:15 PM

#

what about loading the subscene into a new world, then transferring the entities over?

slim nebula Oct 25, 2020, 6:15 PM

#

FatThunk

stiff skiff Oct 25, 2020, 6:16 PM

#

You can use EntityManager.MoveEntitiesFrom(out NativeArray<Entity>, EntityManager)

#

To move the entities from the new world, into the one you want your "room" in

#

and it nicely provides an array with what the new id's are

slim nebula Oct 25, 2020, 6:17 PM

#

hmm ok. time to learn about making my own worlds I guess

#

so far I only been using client world and server world

stiff skiff Oct 25, 2020, 6:17 PM

#

Note that you probably need this anyways

#

since Load doesnt give you the list of loaded entities back

#

which you need to offset them in your world later

#

unless you want every room to overlap

slim nebula Oct 25, 2020, 6:18 PM

#

ah ok

stiff skiff Oct 25, 2020, 6:19 PM

#

(Small note, i've never used subscenes. Just giving some ideas)

slim nebula Oct 25, 2020, 6:19 PM

#

ok

#

yeah I dunno. I'm just trying to do a random level generation kinda thing. Figured subscenes would be better performance than prefabs, but it looks like some stuff might be missing for me to do this. I'll try playing with loading in different worlds and transferring between them. thanks

#

I guess I also worry if using this other-world loading method will even be faster/better than just using prefabs straight up...

valid haven Oct 25, 2020, 6:43 PM

#

What are the blockers currently that would prevent/make trouble for starting a new game (open world multiplayer game) and using ECS/DOTs in a limited capacity for CPU intensive tasks and physics? Keeping in mind this project wouldn't be ready for primetime for quite sometime. I want to use the havoks physics system as a minimum, to take advantage of its improved floating point accuracy (50k units vs 4-8k).

olive kite Oct 25, 2020, 6:55 PM

#

Can anyone explain why they use the .WithNativeDisableParallelForRestriction instead of just passing the component data through a ref in the guard/player Unity example?

📎 unknown.png

olive kite Oct 25, 2020, 7:26 PM

#

And the notes make it sound like they are writing to the player but they are just writing to all of the playertarget entity components (unless I am understanding it incorrectly) so I'm a bit confused on what they are doing, which makes me think I don't understand it fully.

fluid kiln Oct 25, 2020, 7:48 PM

#

Any doc on NetCode's conversion system with sub scenes? I can't find anything

slim nebula Oct 25, 2020, 8:29 PM

#

I don't think subscene stuff is really documented much @fluid kiln

#

what conversion system do you mean? ghosts?

fluid kiln Oct 25, 2020, 8:38 PM

#

I thought the subscene conversion was related to NetCode but it's actually DOTS itself. I've looked it up thank you 🙂

pliant pike Oct 25, 2020, 8:53 PM

#

Is there not an opposite for ComponentDataFromEntity? I need to get the entity from the component tag

slim nebula Oct 25, 2020, 8:53 PM

#

isn't that just a normal entity query?

pliant pike Oct 25, 2020, 8:54 PM

#

I can't get entity's directly with an entityquery can I?

slim nebula Oct 25, 2020, 8:54 PM

#

Entities.ForEach((Entity entity, MyComponentTag tag) => {...});

#

should get any entity that has ur tag

#

i dunno if there's another way

pliant pike Oct 25, 2020, 8:55 PM

#

yeah I know that but I need to get them using a literal entityquery like

#

m_Query = GetEntityQuery(ComponentType.ReadOnly<ObstacleAuthoring>())

slim nebula Oct 25, 2020, 8:55 PM

#

I'm pretty new myself sorry :S

pliant pike Oct 25, 2020, 8:56 PM

#

that just gets the tag and I need to get the entity attached to that tag so I can get another component

slim nebula Oct 25, 2020, 8:58 PM

#

Entities.ToEntityQuery().ToEntityArray()

#

this looks fun

#

maybe you can reduce the collection then get the 0-index element

#

using linq or fluant API stuff or somethin I dunno

#

wrap it into an extension method

pliant pike Oct 25, 2020, 8:59 PM

#

that's too complicated for me leahS

slim nebula Oct 25, 2020, 8:59 PM

#

sadCarbotLing

coarse turtle Oct 25, 2020, 9:02 PM

#

wait so given a tag you want to get the entity associated with the tag?

pliant pike Oct 25, 2020, 9:02 PM

#

yeah

coarse turtle Oct 25, 2020, 9:02 PM

#

Entities.WithAll<Tag>().ForEach((Entity e) => {})?

#

that could work too

pliant pike Oct 25, 2020, 9:03 PM

#

yeah I've done that

#

but I need to get another lot in that job with a different tag

#

I've got the same componentdata I want to use, "translation" but two sets tagged differently I need to compare their translations

coarse turtle Oct 25, 2020, 9:06 PM

#

o, yeah you might want two queries and build some sort of map so you can do the comparisons

slim nebula Oct 25, 2020, 9:07 PM

#

is the component variable that you're using to do the look up, is that variable a ref? because if it's not, then it's just a copy, and there's no way to distinctly identify it.

#

maybe I'm totally misunderstanding what you're doing sorry XD

#

ignore me

#

I dunno

coarse turtle Oct 25, 2020, 9:09 PM

#

well I guess you could also use an IJobChunk and check if the tags exist on the chunk

#

so you have chunk based logic - which could help you do comparisons better 🤔

pliant pike Oct 25, 2020, 9:10 PM

#

but I hate Ijobchunks 😠

slim nebula Oct 25, 2020, 9:10 PM

#

sadCarbotLing

pliant pike Oct 25, 2020, 9:11 PM

#

anyway I'll post on the forums see if anyone there has any hints, thanks guys

brazen storm Oct 25, 2020, 9:12 PM

#

trying to raycast a bunch of terrain Coordinates.

📎 unknown.png

slim nebula Oct 25, 2020, 9:13 PM

#

that's purple (I havn't leard jobs yet sorry)

brazen storm Oct 25, 2020, 9:13 PM

#

it is

valid haven Oct 25, 2020, 9:14 PM

#

What are the issues currently that would prevent/make trouble for starting a new game (open world multiplayer game) and using ECS/DOTs in a limited capacity for CPU intensive tasks and physics? Keeping in mind this project wouldn't be ready for primetime for quite sometime. I want to use the havoks physics system as a minimum, to take advantage of its improved floating point accuracy (50k units vs 4-8k).

slim nebula Oct 25, 2020, 9:14 PM

#

do you plan to use unity.netcode @valid haven

valid haven Oct 25, 2020, 9:15 PM

#

I am currently leaning to MLAPI, but I would use the unity.netcode if it was ready early enough in the dev process.

slim nebula Oct 25, 2020, 9:16 PM

#

havok is a cached physics system. it's performance benefits don't really work when using physics prediction.

#

prediction for the purposes of netcode

pliant pike Oct 25, 2020, 9:16 PM

#

@brazen storm thanks query.ToEntityArray is probably what I was looking for, just in the wrong place

valid haven Oct 25, 2020, 9:16 PM

#

Using havok is tied to its larger coordinate system, not related to that.

#

unity physics and physx starts breaking around 4-8k from origin, new havok is stable up to 50k

slim nebula Oct 25, 2020, 9:17 PM

#

if you're not doing physics predictions with netcode, then it's not a problem

valid haven Oct 25, 2020, 9:17 PM

#

I wont need to do deterministic rollbacks

slim nebula Oct 25, 2020, 9:17 PM

#

👍

valid haven Oct 25, 2020, 9:18 PM

#

I guess my main question is, if I do use DOTS/ECS for a couple subsystems like physics and projectile/enitty movement updates am I going to run into limitations with other subsystems and/or editor features?

slim nebula Oct 25, 2020, 9:19 PM

#

not that I know of but I'm kinda new. that one was the only one I could think of

valid haven Oct 25, 2020, 9:20 PM

#

I am not clear on how all or nothing using ECS is.

vapid hamlet Oct 25, 2020, 9:21 PM

#

Is the new dots net code even usable at this point?

slim nebula Oct 25, 2020, 9:22 PM

#

seems to be workin for me mullagain

#

I dunno how extensible it is tho

#

their demo is supposed to support 80 clients right?

pliant pike Oct 25, 2020, 9:22 PM

#

you can hook the ECS data into monobehaviour pretty easily in my opinion (don't quote me on that though)

slim nebula Oct 25, 2020, 9:23 PM

#

there are some (maybe lots?) things you still need to write custom authoring components for

vapid hamlet Oct 25, 2020, 9:23 PM

#

Im new to unity and I’m a bit lost on the dots vs old system. Lots of examples for the old. Any examples for the new?

#

Specifically with netcode

slim nebula Oct 25, 2020, 9:23 PM

#

there was the DOTSSample github, but it doesn't run latest unity or latest packages

pliant pike Oct 25, 2020, 9:24 PM

#

I havent done much with both together but you can just use the EntityManager in a monobehaviour to get the entities and the data you want for instance

slim nebula Oct 25, 2020, 9:24 PM

#

I learned that one and have been slowly updating my project haha

vapid hamlet Oct 25, 2020, 9:25 PM

#

Been digging on some documentation. Just can’t find it

slim nebula Oct 25, 2020, 9:29 PM

#

https://www.youtube.com/watch?v=P_-FoJuaYOI

YouTube

Unity

Introduction to the DOTS Sample and the NetCode that drives it - Un...

Dive deep into the networked future of Unity using DOTS. Hear how we made the DOTS Sample a networked game, and what we learned on the way.

Speaker:
Tim Johansson - Unity

Learn more about the Data-Oriented Tech Stack (DOTS): https://on.unity.com/2lraugz

▶ Play video

#

@vapid hamlet

#

it's old tho

#

much changed

vapid hamlet Oct 25, 2020, 9:29 PM

#

Yeah. Is there any official documentation?

#

Something kept up to date

slim nebula Oct 25, 2020, 9:30 PM

#

https://docs.unity3d.com/Packages/com.unity.netcode@0.4/manual/getting-started.html

pliant pike Oct 25, 2020, 9:30 PM

#

the pinned messages up top have lots of references

shy pilot Oct 25, 2020, 11:00 PM

#

is there a particular reason in dots to use fields and not properties?

slim nebula Oct 25, 2020, 11:00 PM

#

components and buffers are structs. you can use properties on systems tho if u want

shy pilot Oct 25, 2020, 11:01 PM

#

i don't see any errors though with this:

public interface IGenderBase : IComponentData
{
    public FixedString64 name { get; set; }                             //Name of the gender
    public bool seekMate { get; set; }                                 //Should the creature actively seek a mate
    public FixedString64 compatabilityPattern { get; set; }               //List of genders that the creature can mate with
}

/// <summary>
/// Data for gestation and pregnancy
/// </summary>
public struct IGestation : IGenderBase
{
    public FixedString64 name { get; set; }
    public bool seekMate { get; set; }
    public FixedString64 compatabilityPattern { get; set; }
    public float gestationFinishTime { get; set; }
    public bool gregnant { get; set; }
}

#

does that not work?

slim nebula Oct 25, 2020, 11:03 PM

#

I have not tried myself but I assume it would. It just might be a little more difficult to see what the backing field data is if you start putting a bunch of logic in those properties. But I dunno that's all subjective I guess

shy pilot Oct 25, 2020, 11:04 PM

#

yeah, the most i would put in them is default values

slim nebula Oct 25, 2020, 11:04 PM

#

I think the roslyn compiler will optimize out the property function calls, but I'm not sure if the unity/mono compiler does. Maybe properties are a tiny bit slower? I dunno

shy pilot Oct 25, 2020, 11:06 PM

#

hmm

#

i'm sure an answer will emerge as dots starts to get proper documentation 😆

#

this isn't a long standing project, i'll be done with it in a couple of weeks so i don't mind if it isn't perfectly optimised

brazen storm Oct 25, 2020, 11:07 PM

#

any ideas on passing a component variable to a UI text?

shy pilot Oct 25, 2020, 11:09 PM

#

@brazen storm what do you mean?

#

ohh

#

you mean the component as a whole?

brazen storm Oct 25, 2020, 11:11 PM

#

I mean passing a value to a UI part of a gameobject

#

also. how can I get the entity to get buffer from? I want the buffer from it to do some raycasts in parallel.

📎 unknown.png

fluid kiln Oct 25, 2020, 11:41 PM

#

So in NetCode 0.4, how is someone meant to create server-only or client only entities in the editor?

deft stump Oct 25, 2020, 11:44 PM

#

any ideas on passing a component variable to a UI text?
@brazen storm
You can do a GameObject.Find in a system

brazen storm Oct 25, 2020, 11:46 PM

#

thanks! @deft stump I think i got that bit. trying to get entity from a query and pass it to a lambda.

zinc plinth Oct 26, 2020, 12:14 AM

#

@shy pilot fields and what you're doing with inheritance are object oriented, you want to avoid that at all cost in dots since we're in dod/dop

#

and if you're mixing inheritance with data oriented you're just making a pipe bomb

steady blaze Oct 26, 2020, 1:22 AM

#

hi, when using unity jobs is it recommended to use NativeContainers as much as possible or only for data needed for the Job(s) and main thread?
And use regular Arrays/Lists, etc. in the main code?
btw. don't want to use ECS yet (still GOs), only Job-System for now.

coarse turtle Oct 26, 2020, 1:23 AM

#

yea that's the idea

#

although if you want to interface something with like DrawMeshInstanced (for example) you can use a ptr to fill in the array

deft stump Oct 26, 2020, 1:25 AM

#

hi, when using unity jobs is it recommended to use NativeContainers as much as possible or only for data needed for the Job(s) and main thread?
@steady blaze it's not only recommended it is the only way to use Jobs in any meaningful way.

steady blaze Oct 26, 2020, 1:25 AM

#

what? to use the NativeContainers as much as possible or only for shared data?

#

at least for stuff that needs to be set in the editor it seems i cannot use i.e. NativeArray

steady blaze Oct 26, 2020, 1:44 AM

#

Hm, don't think I will need DrawMeshInstances, but want to use the jobs for Mesh-Generation (terrain), so I will have to pass the results to the MeshFilters of gameobjects.

coarse turtle Oct 26, 2020, 1:48 AM

#

yea native array will work for that

#

you can use the low level mesh api, Mesh.SetVertexBufferData(some_native_array, some_vertex_descriptors)

brazen storm Oct 26, 2020, 1:56 AM

#

Ok! I just found out the difference between the two getbuffer methods! ECS doesn't seem to like me requesting the buffer between lambdas. Is anyone knowledgeable on setting dependencies for a query?

📎 unknown.png

steady blaze Oct 26, 2020, 2:36 AM

#

hm, okay - but still not really an idea if I should use the NativeContainers everywhere possible or just for shared data (between main & jobs).
Also I guess the NativeContainers can only contain primitive data types and structs?
So i.e. when I need an Array/List of GameObjects it needs to be a regular one.
But when it contains only int or Vector3 - and is used only in the Main Thread, should it be regular or Native?
And when used inside a Job (but only there) use regular or native types?

#

(as said: don't want to use ECS yet (only Jobs), but regular GOs with Monobevaviour for now)

humble elk Oct 26, 2020, 2:51 AM

#

So I've been looking all over the internet for a way to do this, but haven't found anything yet. I'm hoping you guys could help.
Here's my problem: I'm starting to make a VR game with the SteamVR plugin, but I want to use ECS. I've converted the Player prefab to an Entity (with injection), but I can't actually access any of the SteamVR Player class attributes from within a system.
So let's say I have a HealthSystem. How would I make the Player class respawn somewhere if it doesn't actually have access to any of the entity data?

steady blaze Oct 26, 2020, 2:52 AM

#

this stuff is new to me, and there does not seem to be much documentation or best practises.
so it's really hard to tell where to use what.

#

also I wonder if there is a more comprehensive manual/reference to unity.mathematics - as it seems to have quite nice noise functions built in, using seeds, etc.

deft stump Oct 26, 2020, 2:55 AM

#

@steady blaze if you're trying to get data from some jobs thread. you need to use native containers.
Also, I don't undertand what you mean by use it everywhere.

steady blaze Oct 26, 2020, 2:57 AM

#

@deft stump I mean if it makes sense to use native containers for stuff that is only needed in the main "thread" or only within a certain job.

deft stump Oct 26, 2020, 2:57 AM

#

use it only within a certain job

#

coz native containers doesn't have the benefit of being GC'ed so having them everywhere is a Disposing/mem leak nightmare

steady blaze Oct 26, 2020, 2:59 AM

#

ah ok, I see, so better don't use them, when not needed?
(or could it also speed things up in the main thread and just use dispose when done?)

deft stump Oct 26, 2020, 3:00 AM

#

(or could it also speed things up in the main thread and just use dispose when done?)
nope it doens't speed anything up in the main thread.
It's primary purpose is just putting data for the job to process and using the same native container to pull data out of the job when it's done processing.

steady blaze Oct 26, 2020, 3:01 AM

#

the 2nd thing: when i calculate stuff within a Job, where only the Job needs that data and can dispose when finished, use native there or regular?

shy pilot Oct 26, 2020, 3:01 AM

#

native with tempjob i think

#

then call .dispose at the end

steady blaze Oct 26, 2020, 3:01 AM

#

@deft stump ok thx, that helps a lot already.

deft stump Oct 26, 2020, 3:02 AM

#

@steady blaze here's a vid

#

https://www.youtube.com/watch?v=vSxcZVfJn74

YouTube

Brian Will

the Unity job system

▶ Play video

#

~~I need to link people this video when people ask for jobs related stuff~~

steady blaze Oct 26, 2020, 3:03 AM

#

@shy pilot what i meant is when i have to calculate stuff within a job that is not needed elsewhere.

#

@deft stump thx, will watch that now, hope it helps!

hollow sorrel Oct 26, 2020, 3:05 AM

#

@steady blaze you want to still use nativearray in the job even if it's not used outside because managed allocations have performance impact in jobs
also regular arrays would prevent you from using burst

steady blaze Oct 26, 2020, 3:07 AM

#

@hollow sorrel perfect, that's what i wanted to know. with this 2 informations i already get a lot further.
Will use NativeList too, hope they are solid enough already.

#

should be possible with NativeArray somehow too, but I guess it won't work well, if I assign new NativeArrays all the time with different sizes.
what could work better (if NativeList is to early): Set the size of the NativeArray to the size of elements there could be at most and in the end copy only the needed elements to a new one.

#

But I will try with NativeList first, hope it's solid enough …

#

@deft stump the video explains a lot, thx. But I wonder if there is a written version with nearly the same content?

#

I will use the job-system a bit different (on-the-fly terrain generation) then in the typical use-case (every frame), so i have to figure out some stuff.
i.e. new jobs only need to get started, when a player moves over the boundaries of the current "terrain-chunk" (or maybe better call it "area" to not confuse with unity chunks?) or manipulation of areas.

#

it should work fast enough without jobs, if i create all the data at start (maybe even the meshes?) and then just load/unload, but i guess not for infinite terrain that only needs a seed - and stores only the areas which have been modified by the player.
So it should be fast enough for on-the-fly generation.

#

i know compute shader may be even better suited, but harder to learn (and i don't have a code-editor that understands HLSL)
thanks a lot @hollow sorrel and @deft stump - i can now image a lot better how to build this from my single-threaded/single-object code.

One last question: when I schedule a job and call the complete immediately, like: var jobHandle = _job.Schedule(areas.Count, 1); jobHandle.Complete();
i.e. in Start() - is it ok to us Allocate.Temp for the NativeArray then, even, if completion takes longer, i.e. 1 second? As the main thread is locked and no frame passes by it should still be within the same frame.

deft stump Oct 26, 2020, 3:50 AM

#

Yes

#

if its immediately complete right after a sched, then it's best to use Temp.

#

It still counts as frame 1

steady blaze Oct 26, 2020, 3:52 AM

#

ok thanks, that's fine too then. will have to figure out when to best schedule and complete, when running around, but until getting there it will take me a few days (at least) anyway.

#

the only thing I still need to figure out is how to use Unity.Mathematics correctly.
Should be better then another simplex/perlin noise library, as it's optimized, should have that included and can be used within jobs and also burst, i guess.

shy pilot Oct 26, 2020, 5:08 AM

#

better call it "area" to not confuse with unity chunks
@steady blaze i've made the same decision after a week of confusing myself 😆

#

can someone tell me if this is ok (not too oop-land)

📎 unknown.png

safe lintel Oct 26, 2020, 5:16 AM

#

@shy pilot even if that technically works, its not job or burst compatible, and you should probably force yourself to use fields to force yourself to learn using entities in conjunction with burst jobs

shy pilot Oct 26, 2020, 5:17 AM

#

ok, thanks

#

is inheritance bad practice for components?

safe lintel Oct 26, 2020, 5:18 AM

#

dont think it even works with ecs

#

you cant do inheritence with structs

shy pilot Oct 26, 2020, 5:19 AM

#

i was trying to make interfaces that inherit from icomponentdata

#

but to declare stuff in them they had to be properties

#

so can burst just not do properties?

#

or just not ones with logic?

safe lintel Oct 26, 2020, 5:22 AM

#

i think it can, but it looks like you want to do things that are questionable in the context of dots, namely use UnityEngine.Time in places where you ideally wouldnt be using it

shy pilot Oct 26, 2020, 5:23 AM

#

yep, i only had that there as a shortcut that would require less code 😆

#

i can certainly live without it

#

and things like that

#

📎 unknown.png

#

does burst work in that sense?

safe lintel Oct 26, 2020, 5:24 AM

#

ive never tried personally

shy pilot Oct 26, 2020, 5:25 AM

#

how does one tell?

safe lintel Oct 26, 2020, 5:26 AM

#

well if it errors when you use it, there you go

#

in the context of unity's own code, ive never seen a property used in any builtin component, so that leads me to believe that you should generally just not use them

#

and these examples seem somewhat trivial in the time they save, but i get it, dots does add more boilerplate to a lot of cases

shy pilot Oct 26, 2020, 5:29 AM

#

yep, ok thanks

deft stump Oct 26, 2020, 5:44 AM

#

i believe properties does have some operation to be done despite how it looks in which icd's doesn't like.

dull copper Oct 26, 2020, 9:23 AM

#

The week of new dots packages to land

deft stump Oct 26, 2020, 9:34 AM

#

👏

#

let's not jinx it lol.

craggy orbit Oct 26, 2020, 10:11 AM

#

tuesday 🎉

#

wait that's tomorrow!! 🎉

amber flicker Oct 26, 2020, 10:12 AM

#

I believe they've said 'week of 27th' and... dots timelines.. but 🤞

deft stump Oct 26, 2020, 10:12 AM

#

Don't jinx it!

craggy orbit Oct 26, 2020, 10:12 AM

#

i thought they said the day of 🤔

#

ah yes it is the week of

#

my bad

#

ah no i did see the 27th specifically. in the Hybrid Renderer v2 thread

📎 Screen_Shot_2020-10-26_at_4.13.42_AM.png

deft stump Oct 26, 2020, 10:14 AM

#

link to the forum?

craggy orbit Oct 26, 2020, 10:15 AM

#

https://forum.unity.com/threads/hybrid-renderer-v2-0-4-0.847546/page-9
3/4ths of the way down

Unity Forum

Hybrid Renderer V2 (0.4.0)

Getting a bunch of these notifications in the console, not sure of what impact its having?

The shader is likely using 16-bit half floats for the...

amber flicker Oct 26, 2020, 10:15 AM

#

Yea there was one of each.. I'm aligning my expectations with 'later than the most pessimistic deadline' 😅

craggy orbit Oct 26, 2020, 10:15 AM

#

can't figure out how to link to a specific message, sorry :/

#

eehhh bit more than 3/4ths

amber flicker Oct 26, 2020, 10:15 AM

#

@craggy orbit you can do that by clicking on the #number

craggy orbit Oct 26, 2020, 10:15 AM

#

ah thank you!

#

https://forum.unity.com/threads/hybrid-renderer-v2-0-4-0.847546/page-9#post-6444188

zinc plinth Oct 26, 2020, 10:34 AM

#

@shy pilot never use getter and setter in components

#

It's not how ecs is supposed to work

#

And I don't think that'll even work

#

Struct are blobs 9f packed data in memory

pulsar jay Oct 26, 2020, 10:42 AM

#

Any idea how I can select one entity and deselect all previously selected?
I am currently trying this:

´´´
var selectedEntity = RaycastPhysicsWorld();
if (selectedEntity != Entity.Null) EntityManager.AddComponent(selectedEntity, typeof(Selected));

Entities.WithAll<Selected>().ForEach((Entity entity, int entityInQueryIndex) =>
{
if(entity != selectedEntity) commands.RemoveComponent<Selected>(entityInQueryIndex, entity);
}).Schedule();
´´´

#

But this just deselects all (including the just selected) entities

amber flicker Oct 26, 2020, 10:52 AM

#

@pulsar jay I can't guess exactly what's going on. My guess is it's a timing issue related to when the command buffer runs or maybe some issue related to the captured entity. I think you can simplify this though if you want to only have one entity selected at a time by doing e.g.:

// In OnCreate
AnySelectedQuery = EntityManager.CreateEntityQuery(typeof(Selected));
// In Update
EntityManager.RemoveComponent<Selected>(AnySelectedQuery);
var selectedEntity = RaycastPhysicsWorld();
if (selectedEntity != Entity.Null) EntityManager.AddComponent(selectedEntity, typeof(Selected));

pulsar jay Oct 26, 2020, 10:55 AM

#

Ah thx @amber flicker makes it easier to do it without jobs

amber flicker Oct 26, 2020, 10:56 AM

#

also bulk manipulations (e.g. EntityManager.XX(query)) of archetype are much faster in general - though maybe not depending on number of entities involved etc - but they're good to use where possible I feel

pulsar jay Oct 26, 2020, 10:58 AM

#

yeah didnt know yet it was that easy to bulk remove components with entity manager

#

great it works 👍

brazen storm Oct 26, 2020, 11:37 AM

#

Ideas on handles/dependancies for lambdas and queries?

rancid geode Oct 26, 2020, 11:39 AM

#

@shy pilot never use getter and setter in components
@zinc plinth there is no problem using getters and setters with burst, I use those myself

zinc plinth Oct 26, 2020, 11:43 AM

#

@rancid geode if you want spaghetti code and go against dop, be my guest Shrugging

deft stump Oct 26, 2020, 11:45 AM

#

how is getter and setter cause spaghetti?

zinc plinth Oct 26, 2020, 11:45 AM

#

it's against dop

rancid geode Oct 26, 2020, 11:45 AM

#

It is not against dop by any means...

zinc plinth Oct 26, 2020, 11:46 AM

#

components should be the data inside the struct, if you want derived data use methods inside a utility class

rancid geode Oct 26, 2020, 11:46 AM

#

If you have internal logic, yes it is, but take for example localtoworld

deft stump Oct 26, 2020, 11:46 AM

#

if you don't do any operations inside those getter and setter, then... it's not all too different than a normal field, I believe.

zinc plinth Oct 26, 2020, 11:46 AM

#

@deft stump but then why use getters at all ?

rancid geode Oct 26, 2020, 11:47 AM

#

components should be the data inside the struct, if you want derived data use methods inside a utility class
@zinc plinth did you already took a look how Colliders works in Unity Physics?

deft stump Oct 26, 2020, 11:47 AM

#

dunno. but i much prefer to use getter and setter

rancid geode Oct 26, 2020, 11:47 AM

#

@deft stump but then why use getters at all ?
@zinc plinth take a look on localtoworld to see why

#

Sometimes it just makes the code more readable by having useful getters and setters to read and write the data

#

Like a component with multiple bools, but internally they are one single int to optimize the memory used

tight blade Oct 26, 2020, 11:49 AM

#

..whats dop?

amber flicker Oct 26, 2020, 11:49 AM

#

data-oriented-programming

rancid geode Oct 26, 2020, 11:49 AM

#

Data oriented programming, often called data oriented design too

tight blade Oct 26, 2020, 11:50 AM

#

oh. I cant imagine dop has an opinion on something as granular as whether or not you use getters and setters

#

that seems wholly orthogonal

rancid geode Oct 26, 2020, 11:50 AM

#

Getter/setter are just language features

#

And about inheritance, c# doesn't allow inheritance with struct but on c++ using inheritance on ecs components is totally legal and valid in dop

tight blade Oct 26, 2020, 11:52 AM

#

honestly the whole notion of data oriented design is a bit weird. Its a bit of a chimera of different concerns which may be quite different depending on the target.

Haskell, for instance, is the ultimate Data Oriented Design

#

this is more like Tensor oriented design, honestly

#

for which its kind of ridiculous to presuppose there is a preference between various styles of property access (for the most part)

deft stump Oct 26, 2020, 11:54 AM

#

the whole notion of dop is just being cache and cpu friendly.
using language features to aide you doesn't break that notion

rancid geode Oct 26, 2020, 11:55 AM

#

I see that the major pitfall of Unity ecs is that due c# constraints it seems to wrongly teach heir users that some stuff should be avoided on dod, but it is only true due Unity ecs limitations, not because it goes against the "DOD bible"

#

the whole notion of dop is just being cache and cpu friendly.
using language features to aide you doesn't break that notion
@deft stump exactly

tight blade Oct 26, 2020, 11:55 AM

#

yeah totally

rancid geode Oct 26, 2020, 11:56 AM

#

Even going oop in ECS is legal as long that is the right tool for your problem

#

Unless you lost some bet, you don't need to go full DOD in the entire program

tight blade Oct 26, 2020, 11:59 AM

#

yeah I mean whether or not things are a good idea is a different conversation. The static point is that dod doesn't care about your petty implementation concerns. it sits along a different dimension of abstraction and gazes sidelong at your infinitesimal decisions and laughs

#

it hungers only for data volume

#

as you say, if your problem isnt volume oriented, you can safely leave the tensors on the bench

lean raptor Oct 26, 2020, 1:41 PM

#

Can a Unity Job be a ref struct?

vagrant surge Oct 26, 2020, 1:48 PM

#

📎 unknown.png

#

this is code from a personal project

#

not unity, just cpp

#

i have a BossAI component that holds a pointer into an AIImplementation

#

not ecs, thats basically just oop

#

but its literally just for an AI script so who cares

#

you dont need dod on everything

olive kite Oct 26, 2020, 2:49 PM

#

What is the most efficient way to get component data in a gameobject? entityManager.GetComponentData<Translation>(entityRef).Value; is kind of expensive, .7ms for 1000 calls

amber flicker Oct 26, 2020, 2:53 PM

#

if you're doing 1000 calls in a frame you want to be using e.g. Entities.ForEach() and filling a persistent NativeArray that you pass to the job I'd guess.

olive kite Oct 26, 2020, 2:53 PM

#

oh duh, thank you.

amber flicker Oct 26, 2020, 2:55 PM

#

np - good luck 👍

dull copper Oct 26, 2020, 3:02 PM

#

@olive kite can you tell what you need that for?

#

btw is this a new thing in 2021.1?

📎 unknown.png

#

when having dots packages installed, it hides the pause and step buttons on the top bar

deft stump Oct 26, 2020, 3:16 PM

#

well you are using an alpha build so

#

alpha bugs maybe?

craggy orbit Oct 26, 2020, 3:19 PM

#

oh i didn't realize it was caused by DOTS packages. i thought it was just missing for some reason

#

but yeah i dont have it either in the one project i upgraded

amber flicker Oct 26, 2020, 3:20 PM

#

Thought this recent post was interesting: https://forum.unity.com/threads/some-questions-about-the-upcoming-isystembase-interface.994711/

Unity Forum

Some Questions about the Upcoming ISystemBase Interface

Hi Unity devs!

It's not out yet, but I'm looking forward to Bursted systems, and the ISystemBase interface. I'm trying to mentally prepare for the...

brazen storm Oct 26, 2020, 3:21 PM

#

what is this AddJobHandleForProducer guff

tight blade Oct 26, 2020, 3:21 PM

#

OOP vs DOD is a false dichotomy. you can do objects with dod. OOP is bad for totally separate reasons

#

sorry, thats a tangent. continue

amber flicker Oct 26, 2020, 3:22 PM

#

O = oriented, O != only ¯_(ツ)_/¯ -> Baking Oriented Cooking Vs Frying Oriented Cooking 🧑‍🍳

tight blade Oct 26, 2020, 3:24 PM

#

yeah and I mean the important thing is that there are some aspects of "purity" that are just literally n/a not applicable to certain design spaces. There is absolutely no question of whether or not something is "pure dod" if it uses oop in its implementation. that level of decision is simply not within the scope of the domain of dod

#

this is one of the reasons data science code is all over the place

#

there are a lot of dimensions of code design that not required to be consistent to take advantage of tensor processing

dull copper Oct 26, 2020, 3:26 PM

#

@deft stump could be a bug or intentional

pliant pike Oct 26, 2020, 3:28 PM

#

stupid basic question but whats the correct way to dispose of a nativearray

craggy orbit Oct 26, 2020, 3:28 PM

#

nativeArrayInstance.Dispose();

tight blade Oct 26, 2020, 3:28 PM

#

.Dispose() in the same scope you used it, usually

pliant pike Oct 26, 2020, 3:29 PM

#

 protected override void OnStopRunning()
    {
        m_Query.Dispose();
    }

    protected override void OnDestroy()
    {
        base.OnDestroy();
        m_Query.Dispose();
        
    }

    protected override void OnUpdate()
    {       

        var dudents = m_Query.ToEntityArray(Allocator.TempJob);  

        Entities.WithAll<TestObjectAuthoring>().ForEach((Entity inty, in Translation trundle) =>
        {  
            var toppy = GetComponent<Translation>(dudents[0]);

            //Debug.Log("The entity data is " + toppy.Value);
           

        }).WithoutBurst().Run();

        m_Query.Dispose();
        //Enabled = false;
        dudents.Dispose();
     }```

#

I've tried disposing of it everywhere and I just get errors not disposed correctly etc

tight blade Oct 26, 2020, 3:29 PM

#

you marked it as persistent

#

hahaha, yeah @amber flicker

pliant pike Oct 26, 2020, 3:30 PM

#

its meant to be TempJob I just changed it to persistent to check if it worked

tight blade Oct 26, 2020, 3:30 PM

#

oh man, okay ill let this go through a few drafts before comment lol

amber flicker Oct 26, 2020, 3:30 PM

#

why are you disposing a query? I'm so confused

craggy orbit Oct 26, 2020, 3:31 PM

#

and you should mark the array as readonly in the Entities.etc

tight blade Oct 26, 2020, 3:31 PM

#

Calabi is at that early stage of working with tensors and multithreading

#

where it all feels like boilerplate and black sorcery

pliant pike Oct 26, 2020, 3:32 PM

#

I've been working with it for ages actually, but I go away and come back and forget everything or things don't work the way I remember leahS

tight blade Oct 26, 2020, 3:32 PM

#

I hear that

pliant pike Oct 26, 2020, 3:33 PM

#

I'm just throwing things at the wall when in doubt dispose everything

#

as far as I'm aware the dudents dispose should work fine but it doesn't 😕

amber flicker Oct 26, 2020, 3:35 PM

#

don't dispose queries, 2) using TempJob then disposing is fine - I doubt this is where you're problems lie, 3) you can just use .Temp and then you don't need to call dispose

pliant pike Oct 26, 2020, 3:36 PM

#

yeah maybe it's persisting for more than 4 frames etc

amber flicker Oct 26, 2020, 3:37 PM

#

If you're using .Run, just use Temp if you're allocating within an update. Use persistent when you can.

pliant pike Oct 26, 2020, 3:38 PM

#

well it seems I can't use Temp with the job anyway 😕

amber flicker Oct 26, 2020, 3:38 PM

#

probably because you're code doesn't actually look like what you posted 🙂

tight blade Oct 26, 2020, 3:41 PM

#

I'd advise using the IJobChunk to do most of your work until you get comfortable with it, then switch to using the Entities.ForEach shortcut

#

I know its kind of backwards from the end facing recommendations, but just as a learning process, I cant recommend it highly enough

pliant pike Oct 26, 2020, 3:43 PM

#

public class EnvironmentCollisionDetection : SystemBase
{
    public EntityQuery m_Query;
   
    protected override void OnCreate()
    {
        base.OnCreate();
    }

    protected override void OnStartRunning()
    {

        var obstucle = GetSingleton<DotPrefabinator>();
        var soment = obstucle.ObstaclePrefab;

        var dudent = EntityManager.Instantiate(soment);
        EntityManager.SetComponentData<Translation>(dudent, new Translation { Value = new float3(0.5f, 1, 0) });
        EntityManager.SetName(dudent, "TheDudeObstacle");

        m_Query = GetEntityQuery(ComponentType.ReadOnly<ObstacleAuthoring>());        


    }

    protected override void OnStopRunning()
    {
        //m_Query.Dispose();
    }

    protected override void OnDestroy()
    {
        base.OnDestroy();
        //m_Query.Dispose();
        
    }

    protected override void OnUpdate()
    {

        //var entobstacles = m_Query.ToComponentDataArray<ObstacleAuthoring>();

        var dudents = m_Query.ToEntityArray(Allocator.TempJob);

        Entities.WithAll<TestObjectAuthoring>().ForEach((Entity inty, in Translation trundle) =>
        {
            var toppy = GetComponent<Translation>(dudents[0]);

        }).WithoutBurst().Run();     
        //Enabled = false;
        dudents.Dispose();
    }
}```

tight blade Oct 26, 2020, 3:43 PM

#

and lets face it, ecs is all learning at this point

pliant pike Oct 26, 2020, 3:43 PM

#

that's all the code

amber flicker Oct 26, 2020, 3:44 PM

#

and the error you receive is?

tight blade Oct 26, 2020, 3:44 PM

#

I dont think you need to dispose when you use TempJob. I actually have the opposite intuition from @amber flicker

pliant pike Oct 26, 2020, 3:44 PM

#

Unity.Collections.NativeArray`1:.ctor(Int32, Allocator, NativeArrayOptions)
Unity.Entities.ChunkIterationUtility:CreateEntityArray(UnsafeMatchingArchetypePtrList, Allocator, EntityTypeHandle, EntityQuery, EntityQueryFilter&, JobHandle&, JobHandle) (at Library\PackageCache\com.unity.entities@0.14.0-preview.18\Unity.Entities\Iterators\ChunkIterationUtility.cs:265)
Unity.Entities.EntityQueryImpl:ToEntityArray(Allocator, EntityQuery) (at Library\PackageCache\com.unity.entities@0.14.0-preview.18\Unity.Entities\Iterators\EntityQuery.cs:456)
Unity.Entities.EntityQuery:ToEntityArray(Allocator) (at Library\PackageCache\com.unity.entities@0.14.0-preview.18\Unity.Entities\Iterators\EntityQuery.cs:1203)
EnvironmentCollisionDetection:OnUpdate() (at Assets\MyStuff\Scripts\BoxIntersectionCheck.cs:62)
Unity.Entities.SystemBase:Update() (at Library\PackageCache\com.unity.entities@0.14.0-preview.18\Unity.Entities\SystemBase.cs:397)
Unity.Entities.ComponentSystemGroup:UpdateAllSystems() (at Library\PackageCache\com.unity.entities@0.14.0-preview.18\Unity.Entities\ComponentSystemGroup.cs:513)
Unity.Entities.ComponentSystemGroup:OnUpdate() (at Library\PackageCache\com.unity.entities@0.14.0-preview.18\Unity.Entities\ComponentSystemGroup.cs:461)
Unity.Entities.ComponentSystem:Update() (at Library\PackageCache\com.unity.entities@0.14.0-preview.18\Unity.Entities\ComponentSystem.cs:107)
Unity.Entities.DummyDelegateWrapper:TriggerUpdate() (at Library\PackageCache\com.unity.entities@0.14.0-preview.18\Unity.Entities\ScriptBehaviourUpdateOrder.cs:333)```

tight blade Oct 26, 2020, 3:45 PM

#

I think Temp needs to be disposed, TempJob will get auto deallocated... oh, actually it needs to be marked for deallocation as a field

#

Entities.ForEach is gonna be tricky if youre working with an Array

pliant pike Oct 26, 2020, 3:45 PM

#

I also get the 4 frame job warning

tight blade Oct 26, 2020, 3:46 PM

#

because you dont know what its compiling your code into with that Entities.ForEach magic

#

whenever Im operating on nativearrays, I use a job explicitly

pliant pike Oct 26, 2020, 3:48 PM

#

oh and that error only comes up after I stop the program as well

#

and if I comment out this line var toppy = GetComponent<Translation>(dudents[0]); and then use dudent.dispose() everything seems to work fine no errors 😕

amber flicker Oct 26, 2020, 3:49 PM

#

yea I did wonder if the real issue was hidden

#

you don't seem to have a check for if the array .Length > 0

pliant pike Oct 26, 2020, 3:51 PM

#

so that's caused another completely unrelated error 😕

amber flicker Oct 26, 2020, 3:51 PM

#

@tight blade fairly sure about Temp's dispose being no-op and dispose being required for TempJob (whole point being it can allocate for multiple frames - long enough for a job to run in parallel). Also nothing wrong with using arrays and lambdas.

#

@pliant pike hard for me to say concretely - the safety system isn't perfect. Could be worth reporting as a bug if you verify it's actually a nullref exception

brazen storm Oct 26, 2020, 3:53 PM

#

Hey gang! Best way to test for a change in a component variable?

pliant pike Oct 26, 2020, 3:54 PM

#

thanks for help guys, I'll chalk this one up to my usual stupidity

amber flicker Oct 26, 2020, 3:55 PM

#

@pliant pike that error should have told you nullrefexception if that's what actually was going on - don't feel bad - is a little tricky to remote debug that kind of thing though.

#

@brazen storm if (previousVal != currentVal) ? Or you mean something else?

brazen storm Oct 26, 2020, 3:57 PM

#

no no no. I mean the query returns when changed components? unless that's dumb. in which case nevermind

pliant pike Oct 26, 2020, 3:57 PM

#

yeah I normally ignore some errors I usually get like objects does not exist etc because I haven't sorted the order of systems and it usually still works through them

amber flicker Oct 26, 2020, 3:58 PM

#

@brazen storm you can only detect that there's been a change to a chunk - not to a particular entity without iterating through them. You can hash components for faster comparison but e.g. the 'SetChangeFilter' methods filter on the chunk level

brazen storm Oct 26, 2020, 4:00 PM

#

ok tnx @amber flicker

warped coral Oct 26, 2020, 4:02 PM

#

what game genres benefit most from DOTS?

amber flicker Oct 26, 2020, 4:03 PM

#

off the top of my head: wave shooters, bullet hell, rts, deterministic networked stuff etc

warped coral Oct 26, 2020, 4:08 PM

#

can dots handle making a cubey voxel-like game except with actual objects for each cube?

amber flicker Oct 26, 2020, 4:13 PM

#

sure.. so can anything. If you mean "is it fast enough to do X" - that will depend on many things but it's generally faster than traditional Monobehaviours

dull copper Oct 26, 2020, 4:22 PM

#

I'd debate on that :p

#

I'd draw the line in it being generally faster in brute force kinda scenarios

#

but it's also hard to draw the like on what is actually DOTS since Unity internally uses the same job system under the hood as well

amber flicker Oct 26, 2020, 4:43 PM

#

I'd agree right now - though hopefully in the next few months that won't be the case. Joachim has basically stated the goal is to see 1 entity being processed and scheduled by 1 foreach should be cheaper than monobehaviour.Update().

ocean violet Oct 26, 2020, 4:53 PM

#

Hey guys. Can anyone tell me how can I add meshcollider to entity? I'm able to create a mesh with a bunch of vertices and triangles just fine but I can't find any resources that can help me attaching meshcollider to entity. Using monobehaviour, it is just a matter of adding meshcollider and setting meshCollider.sharedMesh = mesh

deft stump Oct 26, 2020, 4:59 PM

#

you need to have Unity Physics

#

can't remember how to add mesh colliders but I believe mesh collider isn't supported? don't @ me on that.
all I remember are box colliders.

ocean violet Oct 26, 2020, 5:06 PM

#

already did include that. But EntityManager.AddComponent(entity, ComponentType.Create<MeshCollider>()) doesn't seem to work

#

https://docs.unity3d.com/Packages/com.unity.physics@0.0/api/Unity.Physics.MeshCollider.html

#

Am i looking at the right place?

rancid geode Oct 26, 2020, 5:12 PM

#

@ocean violet always remember to use the View Latest Version button https://docs.unity3d.com/Packages/com.unity.physics@0.5/api/Unity.Physics.MeshCollider.html

brazen storm Oct 26, 2020, 5:32 PM

#

quick headScratcher. If Im getting a singleton component into a var. can I edit it and pass it back with SetSingleton???

📎 unknown.png

#

like I edit fuelComponent above

deft stump Oct 26, 2020, 5:34 PM

#

you can

brazen storm Oct 26, 2020, 5:36 PM

#

@deft stump aww nice!

#

like fuelComponnet.value = bleh, SetSingleton<VehicleFule>(fuelComponent)

#

While you are here I'm trying to destroy an entity. I put it onto a Dynamic Buffer and I'm calling destroy from the command buffer but the prefab remains.

📎 unknown.png

#

could have done a buffer of the IDs?

#

I don't get why this fails

olive kite Oct 26, 2020, 6:50 PM

#

@olive kite can you tell what you need that for?
@dull copper It is to copy transform data to a gameobject.

dull copper Oct 26, 2020, 6:56 PM

#

@olive kite in that case there are more efficient ways to do that. For example you can take a look at the old GameObjectEntity stuff on how they did it there (look at CopyTransformToGameObjectSystem)

#

basically they used TransformAccess array on a job to pass the transform from entities to gameobjects there

#

it probably still works if you manually add CopyTransformToGameObject to your entity component data

olive kite Oct 26, 2020, 6:58 PM

#

oh ok cool. I am also running it through jobparallelfortransform, but probably not passing the data I'm using for that efficiently

#

i need to do it at a very specific time because of how I am transfering the animation data to the entities

dull copper Oct 26, 2020, 6:58 PM

#

there's basically a ready made setup for all this, you could just copy it for your use cases

olive kite Oct 26, 2020, 6:58 PM

#

yeah

#

ill check out that system.

#

thank you @dull copper

amber flicker Oct 26, 2020, 6:59 PM

#

yea maintaining the list of transforms is the only slightly painful part but definitely worth it to be able to do off main thread (even if it's only a single thread)

dull copper Oct 26, 2020, 6:59 PM

#

I dunno if there's even better ways to handle that now, that system was just something I learned from this channel a long time ago

#

been using that approach on my dots prototypes where I don't use hybrid rendering

olive kite Oct 26, 2020, 7:00 PM

#

yeah that's what i need to do, i am assigning it in the job but holding the data on main

#

But i need to do it 3,000 times per frame

amber flicker Oct 26, 2020, 7:00 PM

#

think it's still the best way afaik - I think it makes sense that there's a special case where the c++ knows you may set them

olive kite Oct 26, 2020, 7:01 PM

#

ok

#

i am pretty sure i will ahve to setup an LOD-like system to lower the update rate on further entities

#

and i may be going down the wrong path completely. I am still doing all the animation and transform tweens in the GO and passing it to entity

amber flicker Oct 26, 2020, 7:02 PM

#

if it's helpful, as an estimate - the read and write time (not inc e.g. interpolation) for 3000 transforms is about 1ms (more like 0.8 but current schedule overhead etc) from my quick test (3900x but it's only using one thread) - only providing as an order of magnitude reference

olive kite Oct 26, 2020, 7:04 PM

#

ok cool yeah i did some testing and it seemed fine but when it's on the GOs it's a little less favorable, and there are still a lot of things to make efficient. the movement calculations from pathfinding is done in the same call so that is next on my list

#

yeah it should be fine , just the transform assignment piece

#

it's exciting though, once you get it lined up, burst is incredible

#

still a lot to clean up though, and getting lots of garbage

📎 unknown.png

amber flicker Oct 26, 2020, 7:11 PM

#

make sure you've got leak detection and burst safety checks off if you're looking at gc or timings at all

olive kite Oct 26, 2020, 7:11 PM

#

physics simulation at 3.5 seconds with only 100 enemies, so thats a problem too

#

ok ill try that i think burst safety is on

amber flicker Oct 26, 2020, 7:11 PM

#

also make sure burst is enabled 🙂 - that physics sounds too slow

olive kite Oct 26, 2020, 7:12 PM

#

yeah i know, not sure whats going on there. i tested with large numbers and it was much lower

amber flicker Oct 26, 2020, 7:13 PM

#

as I'm sure @dull copper will chime in 🙂 - physics perf suffers quite badly with many threads so currently there's an option to limit them if you're using 32 cores or whatever - definitely check in an attached build before doing anything else though

olive kite Oct 26, 2020, 7:13 PM

#

i think i see what it is,

#

yeah i limited it to 4 worker threads, ran into that problem too

#

📎 unknown.png

#

that would be from calling .Complete in code i assume?

amber flicker Oct 26, 2020, 7:16 PM

#

that gc looks like editor checks to me - do any of your jobs have (Burst) in their names? There are some safety tests you can't disable in-editor I think. Anyone know if that's still true?

olive kite Oct 26, 2020, 7:16 PM

#

so it looks like it should be 1/3 of that

#

I don't think so on the Burst names

#

ill check

#

i think i saw that fixed in the last release notes

#

probably this: ;

📎 unknown.png

#

i appreciate your input, thanks

amber flicker Oct 26, 2020, 7:20 PM

#

oh haha yes.. logs would do it

olive kite Oct 26, 2020, 7:20 PM

#

yeah, i looked for debug.log but forgot about the warnings

#

most problems are solved by explaining them

lean raptor Oct 26, 2020, 9:29 PM

#

Can I use the lock statement inside a Unity Job?

#

And if I allocate an object inside a Unity Job, must I pin it?

craggy orbit Oct 26, 2020, 10:23 PM

#

Lock works the same as try catch, afaik. If so, no you cannot use it in a job

#

actually im partially incorrect. here's what the Burst Compiler supports
https://docs.unity3d.com/Packages/com.unity.burst@1.4/manual/docs/CSharpLanguageSupport_Lang.html#language-support

#

you can use try catch, but you just can't catch 🤔

#

it doesnt mention lock support, from what i can tell

stiff skiff Oct 26, 2020, 11:03 PM

#

He didn't specify Burst though, just Jobs

shy pilot Oct 26, 2020, 11:24 PM

#

how does one run .complete on a scheduleparralel foreach

craggy orbit Oct 26, 2020, 11:39 PM

#

Burst and Jobs are normally used together so i dont think my assumption was too far off

median mesa Oct 27, 2020, 12:11 AM

#

If anyone wanna start a DOTS learning/portfolio project or more, hit me up!

shy pilot Oct 27, 2020, 2:22 AM

#

can someone please explain how you run Complete() on a job generated by foreach

coarse turtle Oct 27, 2020, 2:34 AM

#

Entities.ForEach((...) => {}).Schedule(...).Complete() or ScheduleParallel

#

pretty much you can only call complete on the job that has been scheduled

shy pilot Oct 27, 2020, 2:35 AM

#

hmm

#

intellisense can't see that for some reason

#

will try when i get the chance

#

thanks :)

coarse turtle Oct 27, 2020, 2:35 AM

#

try regenerating the csproj files in your project settings

shy pilot Oct 27, 2020, 2:35 AM

#

yeah

valid haven Oct 27, 2020, 2:35 AM

#

one thing that isn't very clear to me with this new DOTs framework is what and when things need to be disposed

shy pilot Oct 27, 2020, 2:35 AM

#

i've found taht i have to do that quite a lot lately

#

if its native

#

you should always dispose of it as soon as you are done using it

valid haven Oct 27, 2020, 2:36 AM

#

dispose of what tho

shy pilot Oct 27, 2020, 2:36 AM

#

usually at the end of a job or when a system is destroyed

coarse turtle Oct 27, 2020, 2:37 AM

#

you typically dispose native data when you're done with it or whenever you need to

valid haven Oct 27, 2020, 2:37 AM

#

hmm ok. Other question I have... if I need to ensure the job is completed before the next frame how do I handle that? For example say I need a job to complete within one deltatime (e.g. situation where every entity within the foreach needs to update per frame so it matches up with physics steps).

shy pilot Oct 27, 2020, 2:38 AM

#

Entities.ForEach((...) => {}).Schedule(...).Complete() or ScheduleParallel
@coarse turtle

coarse turtle Oct 27, 2020, 2:39 AM

#

@valid haven maybe you can run it on the fixed step

valid haven Oct 27, 2020, 2:40 AM

#

does that happen before or after physics update?

coarse turtle Oct 27, 2020, 2:40 AM

#

you can probably have a component system group run before the physics update

#

using the FixedRateUtils

valid haven Oct 27, 2020, 2:42 AM

#

ok thanks

shy pilot Oct 27, 2020, 3:20 AM

#

@coarse turtle my ide says that schedule returns void so i can't run complete?

#

📎 unknown.png

coarse turtle Oct 27, 2020, 3:23 AM

#

That's not true since schedule returns a JobHandle

#

does it compile in Unity?

shy pilot Oct 27, 2020, 3:41 AM

#

i will check

#

📎 unknown.png

#

📎 unknown.png

#

it doesn't seem to return a jobhandle

zenith wyvern Oct 27, 2020, 3:45 AM

#

Show the code where you're scheduling it

shy pilot Oct 27, 2020, 3:46 AM

#

📎 unknown.png

#

am i missing something really obvious 😆

#

ohh

#

do i need a jobhandle?

#

.__.

zenith wyvern Oct 27, 2020, 3:48 AM

#

Are you sure you can put multiple things in WithNone?

shy pilot Oct 27, 2020, 3:49 AM

#

um

#

doesn't None imply there are multiple things

#

wouldn't it be Without otherwise?

#

ok, i changed it from SystemBase to JobComponentSystem

zenith wyvern Oct 27, 2020, 3:51 AM

#

Oh right you only get a handle back if you pass in a jobhandle I think

shy pilot Oct 27, 2020, 3:51 AM

#

and there are no more compiler errors

zenith wyvern Oct 27, 2020, 3:51 AM

#

Pass in Dependency to Schedule

shy pilot Oct 27, 2020, 3:51 AM

#

yeah

#

what are the differences between SystemBase and ComponentSystem?

zenith wyvern Oct 27, 2020, 3:52 AM

#

ComponentSystem was for main thread stuff only but I believe it's going to be deprecated at some point. We're only meant to use SystemBase now

safe lintel Oct 27, 2020, 3:52 AM

#

component system is just the old mainthread version of systembase which does both main and job thread(jobcomponentsystem was the job version)

shy pilot Oct 27, 2020, 3:52 AM

#

so what is the new version of JobComponentSystem?

zenith wyvern Oct 27, 2020, 3:52 AM

#

SystemBase replaces both

shy pilot Oct 27, 2020, 3:52 AM

#

oh

zenith wyvern Oct 27, 2020, 3:53 AM

#

It does some internal stuff to be smarter about dependencies

#

Requires a bit less work and is faster in some cases than JobComponentSystem

shy pilot Oct 27, 2020, 3:53 AM

#

so i can just change override void OnUpdate() to override JobHandle OnUpdate(JobHandle dependency)

safe lintel Oct 27, 2020, 3:54 AM

#

also if you havent already stop using IJobForEach/IJobForEachWithEntity etc because that is deprecated too

zenith wyvern Oct 27, 2020, 3:54 AM

#

No change your Entities.WithNone<>().Foreach().Schedule() to var job = Entities.WithNone<>().ForEach().Schedule(Dependency);

#

It will only return the job handle if you pass in a job handle to schedule

shy pilot Oct 27, 2020, 3:55 AM

#

yep

#

but do i need to get that jobhandle through OnUpdate?

#

or can i just make one?

coarse turtle Oct 27, 2020, 3:55 AM

#

well typically you can grab the Dependency variable from SystemBase

zenith wyvern Oct 27, 2020, 3:56 AM

#

The Dependency property in SystemBase is the jobhandle that your system depends on

safe lintel Oct 27, 2020, 3:56 AM

#

OnUpdate is void now

zenith wyvern Oct 27, 2020, 3:56 AM

#

It's set up automatically by the class so you can use it in OnUpdate

#

@shy pilot Read this for a better explanation https://docs.unity3d.com/Packages/com.unity.entities@0.14/manual/ecs_job_dependencies.html

shy pilot Oct 27, 2020, 6:00 AM

#

ah ok

#

but how do i fetch that jobhandle from update so i can run .Complete 😆

#

or do i just make a new jobhandle

#

ohh

#

i get it 😆

#

thanks :)

#

.Complete Blocks right?

#

just checking

deft stump Oct 27, 2020, 6:14 AM

#

yup

shy pilot Oct 27, 2020, 6:15 AM

#

so the main thread can't continue until that's done?

#

so you're basically writing single threaded code

#

but with extra steps

#

is there a way to make an entity buffer automatically playback on completion?

#

so that i can still keep the benefits 😆

zenith wyvern Oct 27, 2020, 6:23 AM

#

On completion of what?

#

If you mean after a job completes - you can't "schedule" main thread code to run after a job completes. You either wait for it to finish and check each frame with if( jobHandle.IsComplete ) or force it to finish with Complete()

#

What are you trying to do exactly?

shy pilot Oct 27, 2020, 7:28 AM

#

i have some code that updates the state of an entity by adding and removing components

#

which would be done in parralell ideally

#

but i need to make sure any structural changes are done

#

but thinking about it now

#

it doesn't really matter

#

cause its all executing in parallel anyway

#

even if i have to wait for it, it's still much faster

shy pilot Oct 27, 2020, 8:30 AM

#

um, a quick question about IJobParallelFor is giving it a scriptable object considered too oop-land

#

cause i could just copy the fields from the scriptableobject but it seems a bit pointless

#

but if that is going to break burst can someone let me know 😆

deft stump Oct 27, 2020, 8:55 AM

#

If you're using an SO, then I guess the best way is to make a BlobAsset out of it

#

so it won't break burst

half jay Oct 27, 2020, 8:56 AM

#

i have system which create new collider if new BlockType Changed. Should i dispose _collider? or 1st i should destroy collider and then dispose blob asset ref and then create new ?

📎 unknown.png

olive kite Oct 27, 2020, 10:25 AM

#

does anyone know what might be causing these debugstream job completes? it's extending my physics step to 5+ ms

#

📎 unknown.png

deft stump Oct 27, 2020, 10:30 AM

#

Are you calling .Complete() ?

steady blaze Oct 27, 2020, 11:53 AM

#

@zenith wyvern nice, didn't know there is a jobHandle.isComplete - but good to know!

golden heron Oct 27, 2020, 12:07 PM

#

Anyone got experience with the jobs system? Im trying to have one job write to an array, then a second job read from it, but without calling .Complete() in between?

public struct FirstJob : IJobParallelFor
{
     public NativeArray<Vector3> input;
     public NativeArray<Vector3> output;
     public Execute(int index)
     {
           output[index] = input[index];
     }
}
public struct SecondJob : IJobParallelFor
{
     public NativeArray<Vector3> input;
     public NativeArray<Vector3> output;
     public Execute(int index)
     {
           output[index] = input[index];
     }
}

public void RunJobs()
{
     NativeArray<Vector3> firstArray = new NativeArray<Vector3>(objectCount, Allocator.Persistent);
     NativeArray<Vector3> secondArray = new NativeArray<Vector3>(objectCount, Allocator.Persistent);
     var first = new FirstJob
     {
           input = firstArray,
           output = secondArray
     }
     Jobhandle handle = first.Schedule(objectCount,1);
     NativeArray<Vector3> thirdArray = new NativeArray<Vector3>(objectCount, Allocator.Persistent);
     var second = new SecondJob
     {
           input = secondArray,
           output = thirdArray
     }
     handle = second.Schedule(objectCount,1,handle);
     handle.Complete();
}

olive kite Oct 27, 2020, 12:07 PM

#

@deft stump no, I went through and made sure

#

ill double check. That's what I assumed but couldn't find any place it was being manually executed

golden heron Oct 27, 2020, 12:09 PM

#

Any thoughts guys?

olive kite Oct 27, 2020, 12:10 PM

#

@golden heron is that causing error?

golden heron Oct 27, 2020, 12:11 PM

#

it moans about the second job accessing an array which is being accessed by the first.

olive kite Oct 27, 2020, 12:11 PM

#

it looks like you are using dependency of the first job in the schedule of the second which is correct

#

ok let me see..

golden heron Oct 27, 2020, 12:11 PM

#

This is pseudocode, to show the point without bogging down with complex code.

olive kite Oct 27, 2020, 12:11 PM

#

oh

golden heron Oct 27, 2020, 12:11 PM

#

(Each struct is over 100 lines easy)

#

But, Crypto, any thoughts you have are appreciated, even if you dont feel confident... Im a little lost myself atm. :)

#

The above code should work tho, assuming it was added to a class with a private variable for object count, and you added some values to the array, and actually disposed them correctly.

hollow sorrel Oct 27, 2020, 12:17 PM

#

@golden heron add [nativedisableblahblahlongname] to your input arrays

golden heron Oct 27, 2020, 12:17 PM

#

NativeDisableParallelForRestriction i think?

hollow sorrel Oct 27, 2020, 12:18 PM

#

guess safety system doesnt know theyre not running at same time

#

yea

golden heron Oct 27, 2020, 12:18 PM

#

Is that a new thing do you know?

hollow sorrel Oct 27, 2020, 12:18 PM

#

i think its as old as the safety system

golden heron Oct 27, 2020, 12:18 PM

#

Like, the attribute, ive found some code doing it but it isnt clear how

#

The only difference seems to be the arrangement of read/write only attributes, i was hoping to find someone who could say what it is clearly. Ill try that tho.

#

The confusion is that the code i found doesnt use that attribute at all

#

Ok ima just try both... are you interested to hear the result if i find an exact answer, @hollow sorrel

#

"First of all [NativeDisableParallelForRestriction] not solves safety restriction, it's only allow you to write to any index of passed array (if you sure in safety) in same job - solves parallel for restriction." -> from unity forums

olive kite Oct 27, 2020, 12:24 PM

#

yeah that is for same job I thought

golden heron Oct 27, 2020, 12:25 PM

#

It is, apparently

#

And therefore isnt relative... and... i just found some stuff suggesting i completely misinterpreted what the problem is hehe

hollow sorrel Oct 27, 2020, 12:26 PM

#

what do you mean

olive kite Oct 27, 2020, 12:27 PM

#

that it tells the system it is okay to bypass the safety in place to avoid parallel tasks operating on the same array for a particular job

#

but I've not used on multiple jobs before so can't comment

golden heron Oct 27, 2020, 12:28 PM

#

it apparently just lets you access indices outside the range of the batch count you initialise the job with

olive kite Oct 27, 2020, 12:29 PM

#

📎 unknown.png

golden heron Oct 27, 2020, 12:29 PM

#

Atm, the problem appears to be related actually to the system not realising that a jobhandle has been completed when in fact it has, but, as part of a combined jobhandle

#

I should probably mention i am using jobs+burst without ecs

olive kite Oct 27, 2020, 12:29 PM

#

hmm, It is supposed to recognize jobhandles link of dependencies , is that a bug

#

Yeah, idk. that's how I run my jobs, though I just pass the dependency to the schedule call, that's the only difference I see

golden heron Oct 27, 2020, 12:33 PM

#

Im individually storing the jobhandles now, and individually completing them in order, but, from late update after having scheduled everything in update.

#

Oh, that seemed to work...

olive kite Oct 27, 2020, 12:34 PM

#

does it work

golden heron Oct 27, 2020, 12:34 PM

#

Now i have a new error, but, this one is completely different and likely came after all the stuff from before has been completed, which suggests the list of jobhandles worked better.

#

I think the new error was an attempt to dispose an uncreated array... But... that message aint clear at all

hollow sorrel Oct 27, 2020, 12:43 PM

#

whats the error

#

if youre still getting it

golden heron Oct 27, 2020, 12:45 PM

#

Im not now, im just trying to figure out if that is because the problem is solved, or because the other errors are stopping the execution before it happens, it seems i have some incorrectly handled NativeCollections so im just debugging the dispose behaviour, and then ill let you know what/how was done.

#

Ok, so i think that somehow i misinterpreted the original problem based on an incorrect understanding of the error message.

#

The error message was stating something wrong with the nativearray, but the the problem was the inability for the job system to preserve the reference (im guessing that bit) to the handle correctly, when you combine them, so that from the job safety system the handle being checked was a lost handle, replaced by the one which was combined. What specifically happened was that the native array being accessed was in fact requiring the .Complete on its job handle... which was already done, but, incorrectly registered with the job system. The simple solution was a single list of jobhandles instead of a combined handle, and the list is naturally iterated in the order the jobs are added and scheduled, meaning that whilst there is the possibility to be inefficient, there is a good chance it will be ok, short of running some while loop that waits by independently checking "isCompleted" before calling complete, and allowing each to complete at their own speed, i cant think of another solution ... and doing the while loop seems painful and wasteful.

#

@hollow sorrel

#

and... excuse my french but holy sheeshkabob batmen!!! the increase in speed here is incredible...

#

My game has been running slow for a while, hence the decision to bite the bullet and convert.

#

I started by converting the logic to jobs and completing everything and disposing everything right there, so, im kinda using the job system as a sequential single thread, but it allowed me to get the logic into the jobs and back. This worked... and in spite of the inefficiency gave me a small 5-10% speed boost. Next job... Make the allocations in update, and complete in lateUpdate.

#

I just went from 15fps up to 70-90fps 😮

#

📎 unknown.png

#

(rendering options are currently set low to allow me to work on the cpu side of things)

hollow sorrel Oct 27, 2020, 12:56 PM

#

so if i understood correctly, youre manually iterating each jobhandle and completing them in order instead of schedule them with dependencies?
if so that sounds dangerous, what if the 2nd job completes by itself before the 1st?

golden heron Oct 27, 2020, 12:56 PM

#

hehe typical, the screenshot reads a lower fps

hollow sorrel Oct 27, 2020, 12:56 PM

#

also nice to hear the speed increase, are you already using burst?

golden heron Oct 27, 2020, 12:56 PM

#

They are scheduled with dependencies

#

Yes, burst is why i am doing this. I already wrote my own multithreading system, so the jobs system was not really that interesting, but, the burst is ... god in a struct.

hollow sorrel Oct 27, 2020, 12:57 PM

#

👍

golden heron Oct 27, 2020, 12:57 PM

#

Thanks for your comments tho dude. 🙂

olive kite Oct 27, 2020, 2:26 PM

#

is there any way to set a dependency of a job to be all the other currently scheduled jobs without forcing completion ?

#

I am getting a "previously scheduled job" error from a job called "CheckStaticBodyChangesJob" which I assume is something unity is doing, but the conflict is modifying translation array

#

but usually [UpdateAfter(typeof(ExportPhysicsWorld)), UpdateBefore(typeof(EndFramePhysicsSystem))] prevents that in previosu experiences

zenith wyvern Oct 27, 2020, 2:33 PM

#

I don't think so. It sounds like a job from a physics system. You can get the system then get it's job handle to depend on with physicsSystem.GetOutputDependency()

olive kite Oct 27, 2020, 2:34 PM

#

ok perfect that's what I'm looking for

wet epoch Oct 27, 2020, 3:11 PM

#

anyone know how i can do something like this without getting an error? (writing to an array in an Entities.Foreach lambda in 1 system, and reading that array in another) https://hatebin.com/fpqzvrezjm

#

i don't understand why it works with a Job.WithCode().Schedule(), but not a Entities.ForEach().Schedule()

coarse turtle Oct 27, 2020, 3:13 PM

#

I think you might want to expose the JobHandle from SystemA to SystemB or combine SystemA and SystemB but have 2 separate jobs

wet epoch Oct 27, 2020, 3:15 PM

#

those would be workarounds, just wondering if there's a better pattern where i can use arrays in other systems

#

i guess if i'm accessing the other system to get the array, it's not too much extra code to get the job handle

coarse turtle Oct 27, 2020, 3:15 PM

#

I guess the alternative is to have it on an Entity and you query for that specific entity, so SystemA and SystemB depend on Entity with an UnsafeArray/DynamicBuffer that run after each other

wet epoch Oct 27, 2020, 3:16 PM

#

what is the Dependency that we're given? i thought that should include previous systems

#

can i specify a dependency for cases like this?

coarse turtle Oct 27, 2020, 3:17 PM

#

so I'm not exactly sure how the deps are passed around, pretty sure it's in the source code if you want to see how it exactly works, but I'd assume it's like what you said - given the dependencies of the previous jobs scheduled

wet epoch Oct 27, 2020, 3:17 PM

#

it shows as a dependency in this thing

📎 unknown.png

coarse turtle Oct 27, 2020, 3:18 PM

#

Oh I'm not sure about the new DOTS systems tab, I still use the Entity Debugger

wet epoch Oct 27, 2020, 3:19 PM

#

i'm not sure that shows dependencies (i don't know how to see them)

coarse turtle Oct 27, 2020, 3:20 PM

#

yea sorry, I'm not sure either on that case

wet epoch Oct 27, 2020, 3:24 PM

#

same error if i expose the job handle like you suggested 😦 https://hatebin.com/ylihpftqwc

coarse turtle Oct 27, 2020, 3:38 PM

#

hmm

wet epoch Oct 27, 2020, 3:39 PM

#

i could try storing it on an entity, just feels wrong when it's big arrays

coarse turtle Oct 27, 2020, 3:39 PM

#

Well if it's too big, it would be stored into the heap

zenith wyvern Oct 27, 2020, 3:40 PM

#

Can you post the actual error?

#

Which system is it complaining about?

wet epoch Oct 27, 2020, 3:40 PM

#

it's in the first hatebin link

#

InvalidOperationException: The previously scheduled job SystemA:OnUpdate_LambdaJob0 writes to the Unity.Collections.NativeArray1[System.Int32] OnUpdate_LambdaJob0.JobData.arr. You are trying to schedule a new job SystemB:OnUpdate_LambdaJob0, which reads from the same Unity.Collections.NativeArray1[System.Int32] (via OnUpdate_LambdaJob0.arr). To guarantee safety, you must include SystemA:OnUpdate_LambdaJob0 as a dependency of the newly scheduled job.

zenith wyvern Oct 27, 2020, 3:41 PM

#

Weird, your second example gives that same error?

wet epoch Oct 27, 2020, 3:41 PM

#

yeah

zenith wyvern Oct 27, 2020, 3:42 PM

#

From what I'm seeing it should be working I think. Maybe it's due to Unity's weird changes to UpdateBefore/UpdateAfter that they are reversing next update

wet epoch Oct 27, 2020, 3:43 PM

#

the file is self contained if you want to test it

zenith wyvern Oct 27, 2020, 3:43 PM

#

Try adding UpdateBefore to SystemA as well maybe

wet epoch Oct 27, 2020, 3:43 PM

#

k

#

same error

olive kite Oct 27, 2020, 3:46 PM

#

Where do you get this from

📎 unknown.png

wet epoch Oct 27, 2020, 3:46 PM

#

Window > DOTS > Systems

olive kite Oct 27, 2020, 3:47 PM

#

Yeah i see it in the ecs sample but not in my other project

zenith wyvern Oct 27, 2020, 3:47 PM

#

I think it's the new dots editor package

#

It was completely broken when I tried to use it last time

wet epoch Oct 27, 2020, 3:47 PM

#

it gives errors sometimes (like when stopping the game)

#

but when it works it appears to show accurate info

olive kite Oct 27, 2020, 3:48 PM

#

yeah i don't have it in mine , weird

wet epoch Oct 27, 2020, 3:49 PM

#

i'm in 2020.2.0b8 with

📎 unknown.png

olive kite Oct 27, 2020, 3:50 PM

#

must be dots editor

zenith wyvern Oct 27, 2020, 3:50 PM

#

Like everything else it's a hidden package. You need to add com.unity.dots.editor from the package manager

wet epoch Oct 27, 2020, 3:52 PM

#

hmm storing the data in a dynamic buffer would work for this simple test case, but it wouldn't work for like nativemultihashmaps :/

#

which is one of the use cases i have for it (putting entities in 'quadrants' and reading nearby entities from multiple systems)

coarse turtle Oct 27, 2020, 3:53 PM

#

you can use the unsafe version and put that into an IComponentData/ISystemStateComponentData

wet epoch Oct 27, 2020, 3:55 PM

#

hmm the error has changed InvalidOperationException: The previously scheduled job SystemB:OnUpdate_LambdaJob0 reads from the Unity.Collections.NativeArray`1[System.Int32] OnUpdate_LambdaJob0.arr. You are trying to schedule a new job SystemA:OnUpdate_LambdaJob0, which writes to the same Unity.Collections.NativeArray`1[System.Int32] (via OnUpdate_LambdaJob0.JobData.arr). To guarantee safety, you must include SystemB:OnUpdate_LambdaJob0 as a dependency of the newly scheduled job.

#

it's trying to do SystemA second now :/

#

doing the dependency thing i did in the second hatebin seems to make SystemA run first (According to the error)

#

unless it still thinks its being read from next frame...

thorny halo Oct 27, 2020, 4:00 PM

#

Is it possible to use function pointers with the job system? I need to determine which function to use based on some parameters. This function will be called many times, however, it's preferable that the evaluation of which function to call would only happen once, rather every single time. Atm I'm just using a switch statement in another function to determine which function to use.

The only thing i can think of the top of my head would be to create a different struct for every different function and then just evaluate which struct should then be used, though that's a pretty ugly solution.

Pseudo code: https://pastebin.com/QNH31Zke

Pastebin

int2 Step_Ray(Ray_2D ray) { switch (ray_type) { - ...

Pastebin.com is the number one paste tool since 2002. Pastebin is a website where you can store text online for a set period of time.

rancid geode Oct 27, 2020, 4:04 PM

#

@wet epoch on top of that code https://hatebin.com/fpqzvrezjm
this one should work: https://hatebin.com/fmcttuaevs

#

basically you want to expose the sysA dependency and ensure that sysB has sysA as dependency

wet epoch Oct 27, 2020, 4:05 PM

#

this one works (passing dependencies both ways)

#

https://hatebin.com/ipwsryyrpu

#

but seems a bit ridiculous.. trying yours now

#

yeah, with that one you pasted it gives InvalidOperationException: The previously scheduled job SystemB:OnUpdate_LambdaJob0 reads from the Unity.Collections.NativeArray`1[System.Int32] OnUpdate_LambdaJob0.arr. You are trying to schedule a new job SystemA:OnUpdate_LambdaJob0, which writes to the same Unity.Collections.NativeArray`1[System.Int32] (via OnUpdate_LambdaJob0.JobData.arr). To guarantee safety, you must include SystemB:OnUpdate_LambdaJob0 as a dependency of the newly scheduled job.

#

as if it still thinks it's being written to the next frame

rancid geode Oct 27, 2020, 4:07 PM

#

passing both ways does makes sense actually, considering that there is no sync point in your logic currently

wet epoch Oct 27, 2020, 4:07 PM

#

aren't system groups automatically sync points?

zenith wyvern Oct 27, 2020, 4:07 PM

#

I would have thought it would sync automatically at the end of the frame, I guess not

rancid geode Oct 27, 2020, 4:08 PM

#

because system B may still be running when system A is scheduling a new job

zenith wyvern Oct 27, 2020, 4:08 PM

#

So it does seem like it's carrying over to the next frame

rancid geode Oct 27, 2020, 4:08 PM

#

aren't system groups automatically sync points?
@wet epoch no

#

sync point only happens if you call some method from EntityManager that causes one (CreateEntity, DestroyEntity, AddComponent, RemoveComponent...), or if you use an ECB method causes one (same ones as the EntityManager)

#

if no sync point happens, each system can run one whole frame (each system auto-complete its previous frame dependency each frame)

wet epoch Oct 27, 2020, 4:09 PM

#

i assume if you modify some components like Translation too?

rancid geode Oct 27, 2020, 4:10 PM

#

i assume if you modify some components like Translation too?
@wet epoch SetComponent doesn't cause sync point

zenith wyvern Oct 27, 2020, 4:10 PM

#

I basically use this pattern all over the place in my code but yeah I use ECBs so I guess it was just by chance that I wasn't getting dependency errors from it

#

Because I use ECBs all over the place

#

You learn something new every day

rancid geode Oct 27, 2020, 4:11 PM

#

sync point is not the same as completing all jobs that use some component, sync point is where all jobs gets completed (don't matter which component type is being used)

#

setcomponent does causes all jobs that affects the given component to be completed, but not a "full" sync point

wet epoch Oct 27, 2020, 4:12 PM

#

yeah i had no idea it worked like that :/

#

i assumed when you set Dependency, that Dependency gets completed as part of the system group

#

or at least gets passed to dependent systems

zenith wyvern Oct 27, 2020, 4:13 PM

#

if no sync point happens, each system can run one whole frame (each system auto-complete its previous frame dependency each frame)
@rancid geode

But based on the dependency error SystemB does not autocomplete at the end of the frame

rancid geode Oct 27, 2020, 4:14 PM

#

it auto-completes before runing OnUpdate again, not at the end of the frame

zenith wyvern Oct 27, 2020, 4:14 PM

#

Ahh okay, that makes sense

#

Gotcha

wet epoch Oct 27, 2020, 4:15 PM

#

why does it work if I do Job.WithCode().Schedule() instead of Entities.ForEach().Schedule() though :/

rancid geode Oct 27, 2020, 4:15 PM

#

it is like that:

JobHandle previousFrameDependency;
internal void OnUpdateInternal()
{
    previousFrameDependency.Complete();
    OnUpdate(); //defined by user
    previousFrameDependency = Dependency;
}

#

not exactly that, but you got the point

#

why does it work if I do Job.WithCode().Schedule() instead of Entities.ForEach().Schedule() though :/
@wet epoch luckily (or unluckily) it is getting completed earlier probably

#

thus not causing issues with the Scheduling

wet epoch Oct 27, 2020, 4:17 PM

#

so to make this practical i guess i need to work out a way to make B finish at the end of the system group

#

and i guess i have to manually combine A's dependency in B :/

rancid geode Oct 27, 2020, 4:22 PM

#

so to make this practical i guess i need to work out a way to make B finish at the end of the system group
@wet epoch I don't think you want to force that, just combining B dependency into A's should be better

wet epoch Oct 27, 2020, 4:23 PM

#

and A into Bs?

zenith wyvern Oct 27, 2020, 4:23 PM

#

It's really silly that you have to do a whole circular dependency thing

rancid geode Oct 27, 2020, 4:23 PM

#

like what the physics systems do:

sysB OnUpdate:
Dependency = CombineDependencies(Dependency, sysA.GetDependency());
// foo
sysA.AddDependency(Dependency);

syaA AddDependency(JobHandle input):
Dependency = CombineDependencies(Dependency, input);

wet epoch Oct 27, 2020, 4:23 PM

#

in the actual usage, there might be 5 Bs and 1 A

rancid geode Oct 27, 2020, 4:23 PM

#

sysA doesn't really need to know about other systems

#

let the other systems handle that mess

#

another option you have is to make you shared array be an dynamic buffer and attach it to a singleton entity

wet epoch Oct 27, 2020, 4:25 PM

#

if i pretend there's a ECB it seems to fix it

rancid geode Oct 27, 2020, 4:25 PM

#

this way Unity will automatically do all that dependency stuff for you

wet epoch Oct 27, 2020, 4:26 PM

#

then i would need to make a sync point every time I want to use the collection in a job though?

#

(assuming the job is using another query)

rancid geode Oct 27, 2020, 4:26 PM

#

why a sync point?

wet epoch Oct 27, 2020, 4:26 PM

#

to GetSingletonEntity?

#

this isn't pretty, but works https://hatebin.com/pdwzvvahbc

rancid geode Oct 27, 2020, 4:27 PM

#

GetSingletonEntity doesn't cause a sync point at all

wet epoch Oct 27, 2020, 4:27 PM

#

oh ok

zenith wyvern Oct 27, 2020, 4:28 PM

#

If your container is just a list you'd be much better off using a buffer like Bruno suggested. You should only need that pattern if you need to share other kinds of containers

rancid geode Oct 27, 2020, 4:28 PM

#

just ensure to get the entity, not the component directly (as getting the component directly would cause the jobs for that component to complete, which you don't want to)

wet epoch Oct 27, 2020, 4:28 PM

#

yeah the big one is a nativemultihashmap

rancid geode Oct 27, 2020, 4:28 PM

#

then use GetComponent inside the Entities.ForEach/Job.WithCode (which uses GetComponentDataFromEntity internally)

wet epoch Oct 27, 2020, 4:28 PM

#

i think i'll use an entity for any lists/arrays though to avoid this mess

#

ah right, makes sense

rancid geode Oct 27, 2020, 4:29 PM

#

hopefully they will make dealing with native containers less clunky in the future, but for now those are the recommended approaches

wet epoch Oct 27, 2020, 4:30 PM

#

i've done a fair bit of this stuff before and never come across these problems :/

#

not sure if it's a coincidence or something's changed and made it harder

zenith wyvern Oct 27, 2020, 4:31 PM

#

Like me it was probably just a coincidence that you were using ECBs

rancid geode Oct 27, 2020, 4:31 PM

#

just coincidence, it was just recently that I found that too, most of the time I was causing a sync point and never noticed so far haha

zenith wyvern Oct 27, 2020, 4:31 PM

#

Realistically any game is going to need a sync point somewhere

wet epoch Oct 27, 2020, 4:31 PM

#

yeh, just less is better obviously

#

if i'm going to put myself through this i want to get best perf i can out of it 🙂

#

[DependsOn(typeof(SystemA))] would make a lot of sense

#

or for UpdateAfter to just combine it with Dependency automatically

#

even just making Dependency public would help if they intend for us to combine manually

rancid geode Oct 27, 2020, 4:37 PM

#

Dependency public couse cause issues with people using the "=" operator, but having AddInputDependency and GetOutputDependency for SystemBase built-in would be cool haha

#

[DependsOn()] would be even cooler, nice idea

#

but having a hashmap / multihashmap -like dynamic buffer equivalent would solve that too (and other issues)

#

who knows, still a long way until 1.0

wet epoch Oct 27, 2020, 4:41 PM

#

yeah, thanks for your help anyway (and Sark and psuong)

#

i'll begrudgingly add the extra boiler plate 🙂

olive kite Oct 27, 2020, 4:53 PM

#

getting dots to work nicely with a* pathfinding project, but the physics step is still way too long for 200 units, at 8ms, using sphere colliders too

📎 2020-10-27_12-36-14.mov

wet epoch Oct 27, 2020, 4:54 PM

#

unity physics? (the systems are cut off)

olive kite Oct 27, 2020, 4:54 PM

#

havok

#

yeah

wet epoch Oct 27, 2020, 4:55 PM

#

yeah that seems slow :/

#

for 200 spheres

#

have you tried switching to unity physics?

olive kite Oct 27, 2020, 4:58 PM

#

ill try that now

amber flicker Oct 27, 2020, 5:16 PM

#

do you have vsync enabled? Wondering if there's some weird thing where it's trying to do 10 physics updates per frame or something... seems unlikely but that is terrible perf

olive kite Oct 27, 2020, 5:18 PM

#

no, not enabled. I have worker threads at 4 as well (previously was way higher with more worker threads)

amber flicker Oct 27, 2020, 5:19 PM

#

I mean, you possibly want vsync enabled - at least to try.

olive kite Oct 27, 2020, 5:20 PM

#

I showed this before:

📎 unknown.png

#

oh ok ill try enabling

amber flicker Oct 27, 2020, 5:20 PM

#

that looks like 3 physics steps which is odd if you're not doing that manually (I think - having never used physics)

olive kite Oct 27, 2020, 5:20 PM

#

the fixed step group

#

yeah i'm not

wet epoch Oct 27, 2020, 5:20 PM

#

that's only 6ms total?

#

for simulation

olive kite Oct 27, 2020, 5:21 PM

#

yeah, it bounces 6-8

#

with 200 units

wet epoch Oct 27, 2020, 5:21 PM

#

looks like it's doing several physics steps in the frame

olive kite Oct 27, 2020, 5:21 PM

#

exactly, that's what im confused about

amber flicker Oct 27, 2020, 5:22 PM

#

what's your physics update rate vs frame rate?

wet epoch Oct 27, 2020, 5:22 PM

#

i guess because playerloop is 24ms

amber flicker Oct 27, 2020, 5:22 PM

#

yea.. you may be experiencing a type of death spiral - the more you miss frame rate, the more physics step take place (fixed update) and the slower things get

olive kite Oct 27, 2020, 5:23 PM

#

i see what you mean

wet epoch Oct 27, 2020, 5:24 PM

#

so a physics step is really like .5ms

#

excluding the debug part

#

just need to optimize other stuff so less of them run

#

is there a reason all your hoverdrones are gameobjects?

safe lintel Oct 27, 2020, 5:28 PM

#

yeah 200 pure ecs sphere colliders is nothing, but them being gameobjects might be introducing some sort of lag somewhere

olive kite Oct 27, 2020, 5:29 PM

#

yeah, @amber flicker you were right, it scales based on playerloop timing. considering it's fixed, should have been obvious

#

@safe lintel the update functions are less than 1ms, but determinalistic updates on animations are a bit more, so focusing on that now

#

I think its a few different fixed update methods across the board all adding up

safe lintel Oct 27, 2020, 5:43 PM

#

any reason those drones are gameobjects and not pure ecs entities? if they dont have skinned animations i would think they'd be better suited as just entities during runtime

olive kite Oct 27, 2020, 5:47 PM

#

the entire animation setup is through a tween system. Pure is the goal but trying to convert over a piece at a time

#

right now anims and pathfinding still ran through the GO

#

it seems like the editor is killing it. editor frame time is super high and causing a lot of fixed timesteps to repeat 3-4 times

#

even at 9ms

📎 unknown.png

safe lintel Oct 27, 2020, 5:58 PM

#

what are those two other fixedupdates, something objectmanager?

olive kite Oct 27, 2020, 6:25 PM

#

the first two were from my character controller, i found out what was causing that and fixed it, but the physics step is still on rapid fire

dull copper Oct 27, 2020, 9:28 PM

#

I guess no new dots packages today 🤔

stiff skiff Oct 27, 2020, 10:47 PM

#

They saw the cyberpunk delays and figured why not

valid haven Oct 27, 2020, 11:06 PM

#

@dull copper what are we expecting to drop in the new dot packages?

safe lintel Oct 28, 2020, 12:01 AM

#

think they mentioned the 29th

#

but you know how those estimates go..

deft stump Oct 28, 2020, 1:37 AM

#

we shouldn't have jinxed it :notlikethis:

craggy orbit Oct 28, 2020, 2:23 AM

#

my bad 😦

shy pilot Oct 28, 2020, 3:31 AM

#

hehe

#

as excited as i am to have dots closer to completion

#

i'm not looking forward to having to rewrite half my code cause they deprecated something 😅

#

but that's what i signed up for i guess ¯_(ツ)_/¯

deft stump Oct 28, 2020, 3:38 AM

#

I'm pretty sure nothing's gonna be deprecated if you stick to the latest.

safe lintel Oct 28, 2020, 4:46 AM

#

oh snap it was yesterday that the updates were scheduled 😆

hollow jolt Oct 28, 2020, 5:18 AM

#

what does System.InvalidOperationException: HashMap is full mean ?

shy pilot Oct 28, 2020, 8:06 AM

#

@hollow jolt you need to expand the hashmap

#

while they do have a .add method

#

they can't make themselves bigger

#

you need to check if you need to increase the size of the hashmap before adding stuff

shy pilot Oct 28, 2020, 8:49 AM

#

is it not possible to use an entitycommandbuffer in an IJobParallelFor?

#

when i do it i get this InvalidOperationException: The Unity.Entities.EntityCommandBuffer has been declared as [ReadOnly] in the job, but you are writing to it.

#

and when i remove the readonly i get this

#

InvalidOperationException: SpawnStartingPopulationJob.buffer is not declared [ReadOnly] in a IJobParallelFor job. The container does not support parallel writing. Please use a more suitable container type.

#

i take it that means you can't make structual changes from a parallel job

zinc plinth Oct 28, 2020, 8:59 AM

#

ecb.AsParallelWriter or .toConcurrent I don't remember

#

Basically 99% of native Co trainers have a parallel writer api because most operations can't be multithreaded without race conditions showing up

#

@shy pilot

shy pilot Oct 28, 2020, 9:04 AM

#

ok, thanks

#

i'll have a look

#

what does the sortkey paramater mean in the parallel setcomponent method?

#

all the methods take it as a first parameter

#

do i just pass the job iterator?

zinc plinth Oct 28, 2020, 9:19 AM

#

Put the index if w/e you're iterating

This number is used to determine which command should be executed first I think

#

Of *

#

This makes it deterministic, instead of being a full blow' race condition

shy pilot Oct 28, 2020, 9:21 AM

#

ah ok, in my case i don't think it matters much

zinc plinth Oct 28, 2020, 9:21 AM

#

You still need to provide it

shy pilot Oct 28, 2020, 9:21 AM

#

yeah

#

i'm just passing the iterator

shy pilot Oct 28, 2020, 10:08 AM

#

does anyone have an example of unity.mathematics.random in use?

deft stump Oct 28, 2020, 10:18 AM

#

hold my beer.

#

oh wait I don't have one written down XD

hollow jolt Oct 28, 2020, 2:44 PM

#

is it possible for a collision to accrue when scheduling 2 jobs one after another that write to the same ParallelWriter ?

hollow jolt Oct 28, 2020, 3:02 PM

#

so i guess its impossible to read and write to a multihashmap ? had those two

[ReadOnly] public NativeMultiHashMap<int,int> map_reader;
[WriteOnly] public NativeMultiHashMap<int,int>.ParallelWriter map_writer;

which yielded

InvalidOperationException: The writeable Unity.Collections.NativeMultiHashMap`2[System.Int32,System.Int32] TestMultiHash.map_writer is the same Unity.Collections.NativeMultiHashMap`2[System.Int32,System.Int32] as TestMultiHash.map_reader, two containers may not be the same (aliasing).

deft stump Oct 28, 2020, 3:07 PM

#

Well, when you are writing, you have to read it first.

hollow jolt Oct 28, 2020, 3:08 PM

#

but i can't ...

#

NativeMultiHashMap<T1,T2>.ParallelWriter - can't read

#

?_?

stone osprey Oct 28, 2020, 3:30 PM

#

Is it possible to add stuff to a query ? Like "EntityQuery query; query.All(typeof(Movement));" ?

safe lintel Oct 28, 2020, 3:41 PM

#

afaik you shouldnt be changing the query at runtime

#

can always just specify more queries in your initialization though

radiant sentinel Oct 28, 2020, 3:41 PM

#

hello i have this error on opening my scene and sub scenes:

📎 unknown.png

#

on editor time

rancid geode Oct 28, 2020, 3:44 PM

#

as it says, it is a bug, so if you want Unity to fix it I would create a bug report

radiant sentinel Oct 28, 2020, 3:44 PM

#

as it says, it is a bug, so if you want Unity to fix it I would create a bug report
@rancid geode
thank you

hollow jolt Oct 28, 2020, 3:55 PM

#

is there a way to output int values in jobs ? seems like i can only read out the default set value in IJobParallelFor

#

    public struct TestMultiHash : IJobParallelFor  
    {    
        public Random random;
        
        [WriteOnly] public NativeMultiHashMap<int,int>.ParallelWriter map_writer;
        
        public int max_key_index;

        public void Execute( int index )
        { 
            int write_index = index % 10 < 5 ? 0 : ( index % 10 ) - 4 ;

            if( write_index > max_key_index ) max_key_index = write_index;
            
            map_writer.Add( write_index, random.NextInt( 10,20 ) * 100 );
        }
    }

#

max_key_index always results in 0

#

        var map = new NativeMultiHashMap<int,int>( 50, Allocator.TempJob );
        var task1 = new TestMultiHash
        {
            map_writer = map.AsParallelWriter(),
            random = new Random( 7104 ),
            max_key_index = 0
        };        
        task1.Schedule( 50, 10 ).Complete( );
        Debug.Log("max_key_index = " + task1.max_key_index );

hollow sorrel Oct 28, 2020, 4:02 PM

#

@hollow jolt it's because jobs are structs, easiest solution is prob using a nativearray<int> with one value

rancid geode Oct 28, 2020, 4:10 PM

#

in latest collections package there is a NativeReference too, which was created for that exactly need

amber flicker Oct 28, 2020, 4:11 PM

#

ooh really? didn't know about that, nice

hollow sorrel Oct 28, 2020, 4:23 PM

#

oo nice

hollow jolt Oct 28, 2020, 4:28 PM

#

excellent

#

looks like NativeReference<int>( Allocator.TempJob, , NativeArrayOptions.ClearMemory ) have to be disposed as well

zenith wyvern Oct 28, 2020, 4:34 PM

#

Yeah it will still follow the same rules as a NativeContainer. It's just more convenient than having to use the array indexer for a single value like you would with a native array

hollow jolt Oct 28, 2020, 4:35 PM

#

true that

#

I'm still trying to solve aliasing for NativeMultiHashMap, now trying to split the task into a 2 parallel job and 1 normal job process

dull copper Oct 28, 2020, 4:40 PM

#

📎 unknown.png

#

I did not now that setting the physics package thread count hint to 0 will make it single threaded

#

I mean, it does make sense that they do it but I didn't expect them to do that

hollow jolt Oct 28, 2020, 4:42 PM

#

link ?

dull copper Oct 28, 2020, 4:42 PM

#

https://forum.unity.com/threads/unity-physics-slower-performance.995704/#post-6466798

hollow jolt Oct 28, 2020, 4:42 PM

#

ty ty

dull copper Oct 28, 2020, 4:43 PM

#

while I admire what this person does... I don't really think this helps if person tries to make a game with just few characters: I think you should try with 1000 characters and see what that does.

#

I mean, it's totally irrelevant how much you can brute force it if you only care it works for few char instances in the first place (but I don't really know the intended target either)

#

my biggest beef really is that people do dots perf comparisons with scenarios that were never feasible for monobehaviours in the first place

#

it's cool and opens new possibilities but it's not really a nice way to compare the results if it's not a typical usage scenario

safe lintel Oct 28, 2020, 4:46 PM

#

they really need a button that also shows the state of the safety mechanisms in place

#

i hate toggling 3-4 menu option things just to check dots performance in editor(not to mention editor debug mode too), give me more buttons unity 😩

dull copper Oct 28, 2020, 4:52 PM

#

they could just toggle it off when you go to "release mode"

safe lintel Oct 28, 2020, 4:55 PM

#

heh, i tried making an editor script for this a while ago but for whatever reason sometimes toggling those dots options from script doesn't register.

amber flicker Oct 28, 2020, 4:55 PM

#

@dull copper dark theme how? 😅 browser ext or is it a setting somewhere?

hollow jolt Oct 28, 2020, 4:56 PM

#

uses this interface to project a simulation forward into the future. - does it mean physics-ecs is deterministic ?

#

@amber flicker - https://github.com/Max-Github/FireFoxInvertColors - ( this one is handy if u use FF )

hollow sorrel Oct 28, 2020, 4:57 PM

#

i was about to complain about the base cost of physics again but seems it improved a bit since i last checked? getting 0.3ms full jobcount and 0.2ms jobcount 1 (build crashes with 0 for some reason)

#

i remember it being 0.5ms full and 0.3ms jobcount 1 when i last checked thonking

dull copper Oct 28, 2020, 4:58 PM

#

@amber flicker it's some nightmode browser extension

amber flicker Oct 28, 2020, 4:58 PM

#

alrighty, thank you 👍

dull copper Oct 28, 2020, 4:59 PM

#

I'm still waiting for the new round of DOTS packages to land before testing current perf

#

I don't really need physics to be as fast as current physx implementation but physics is one of the things that raise the min spec in my use cases already

hollow sorrel Oct 28, 2020, 5:00 PM

#

do you think bursted systems are going to be next update already

#

that'd prob be pretty huge

#

idk how far along they are

dull copper Oct 28, 2020, 5:01 PM

#

hopefully not as far as burst crossplatform determinism 🤔

amber flicker Oct 28, 2020, 5:01 PM

#

I'm kinda doubtful - maybe mostly the updated codegen stuff?

dull copper Oct 28, 2020, 5:01 PM

#

been waiting that for years before Unity made really clear that they are not even touching that in a while

#

before they were suggesting it was merely few months away

hollow sorrel Oct 28, 2020, 5:02 PM

#

yeah 😭

safe lintel Oct 28, 2020, 5:03 PM

#

we need like a dots bingo or dots betting where you mark off the things you think will be in the next release 😉

#

bets on how long for determinism, how long until a blog post

dull copper Oct 28, 2020, 5:04 PM

#

I bet they just expand the dots debugging

hollow sorrel Oct 28, 2020, 5:04 PM

#

also regarding physics, i really wanna experiment more with seperate worlds, like could imagine a tetris 99 style game where each player runs in a seperate ecs world, but that's pretty much impossible when there's so much base overhead per world
(not suggesting that use case is impossible, you can still do it cramming everything into a single world)

dull copper Oct 28, 2020, 5:04 PM

#

for the next release

#

I mean they do more but that's only think I can think of that is likely to happen

amber flicker Oct 28, 2020, 5:05 PM

#

prefabs & .enabled might be this year but at the current rate, likely not. That'll be a big update.

dull copper Oct 28, 2020, 5:06 PM

#

wasn't the disabling stuff verified to come later already?

amber flicker Oct 28, 2020, 5:06 PM

#

'verified' 😅 - think Joachim said aiming for next few months or smth

dull copper Oct 28, 2020, 5:07 PM

#

that's what I mean, few months meaning it's not going to be on this round of packages

#

it could mean anything but next release

amber flicker Oct 28, 2020, 5:08 PM

#

yea, only thing we know for sure is this update won't include .enabled stuff

dull copper Oct 28, 2020, 5:11 PM

#

I'm currently reading Joachims messages on the bursted systems

hollow jolt Oct 28, 2020, 5:11 PM

#

is there any way to use NativeMultiHashMap in read and write mode in the same parallel job ?

dull copper Oct 28, 2020, 5:12 PM

#

I didn't know they were that far along with it

#

What is missing is code-gen for Entities.ForEach, but we are also almost there with that.

This will significantly reduce the overhead of System.OnUpdate including the cost of invoking Entities.ForEach.Run```

amber flicker Oct 28, 2020, 5:12 PM

#

yea 🤞 - guess it's going to mean refactors at some point

dull copper Oct 28, 2020, 5:16 PM

#

and that's nothing new with dots 🙂

#

they haven't done huge api changes lately so it's about time

#

can't keep people settled :p

safe lintel Oct 28, 2020, 5:21 PM

#

would these changes make that much of a difference in perf though? most of the overhead ive observed seems more related to the job system & cores (then again maybe this improves scheduling speed?)

zenith wyvern Oct 28, 2020, 5:21 PM

#

If you use a lot of systems it could make a huge difference

#

Like hundreds of systems, that's a lot less overhead per system

amber flicker Oct 28, 2020, 5:22 PM

#

I'm really hoping there are some scheduling optimisations in 0.16 - it's so bad right now

hollow jolt Oct 28, 2020, 5:29 PM

#

Any tips for NativeMultiHashMap read and write in the same parallel job ?

zenith wyvern Oct 28, 2020, 5:32 PM

#

The whole point of the ParallelWriter containers is to prevent you from reading and writing in a parallel job

#

I guess you'd have to pass in the normal container and disable safety restrictions

#

Or read all the data you need to read into a separate container and pass it into the write job

hollow jolt Oct 28, 2020, 5:53 PM

#

i tried disabling restriction but it won't write any data

#

[BurstCompile] public struct TestMultiHashRW : IJobParallelFor
{
  [NativeDisableParallelForRestriction] public NativeMultiHashMap<int,int> map;

#

ah nvm it crashed my editor

#

removing parallel restriction works as expected , not sure it failed me last time , thanks

radiant sentinel Oct 28, 2020, 6:02 PM

#

as it says, it is a bug, so if you want Unity to fix it I would create a bug report
@rancid geode can you share the link with me?

rancid geode Oct 28, 2020, 6:03 PM

#

link?

#

to report a bug you go into help => Report a bug

📎 unknown.png

olive kite Oct 28, 2020, 6:18 PM

#

If a paralleljob needs to access an array of floats per item, is the most efficient way to store that data in a NativeArray<NativeArray<float3>> ?

amber flicker Oct 28, 2020, 6:18 PM

#

@olive kite you can't put native containers inside native containers

olive kite Oct 28, 2020, 6:19 PM

#

any suggestions? would it be better to schedule each job separate and schedule them together

rancid geode Oct 28, 2020, 6:23 PM

#

@olive kite I had a similar case, I used 2 nativearrays, one flattened with all the things i need to acces, another one NativeArray<int> being the array of "last index per item"
probably there are better approaches,, but that worked perfectly for me

olive kite Oct 28, 2020, 6:23 PM

#

okay cool, i'll try that. thank you

lean raptor Oct 28, 2020, 8:15 PM

#

Can I use Unity Jobs for long running tasks? I mean, like 1-5 seconds?

shy pilot Oct 28, 2020, 8:28 PM

#

technically you can use it for anything, the question is whether the performance gain is worth it

lean raptor Oct 28, 2020, 8:43 PM

#

Ok, thanks. But if I have a long running task (5 seconds) the game won't block nor suffer thread starvation, right?

dull copper Oct 28, 2020, 9:17 PM

#

@lean raptor https://forum.unity.com/threads/scheduling-long-running-jobs-from-systems.629347/

Unity Forum

Scheduling long-running jobs from Systems

How would I go about scheduling long-running (1-10 seconds) job from a system and how can I obtain a result from it? The job I want to run is...

steady blaze Oct 28, 2020, 11:08 PM

#

Hi, a regular List seems to be convertible to NativeArray with i.e.: points = points.ToNativeArray(Allocator.blabla)
but I also want to convert a regular array to a native array, how can this be done?

hollow sorrel Oct 28, 2020, 11:12 PM

#

@steady blaze pass the array into nativearray constructor

steady blaze Oct 28, 2020, 11:16 PM

#

@hollow sorrel ah yes, thank you! wonder if i could use NativeArray directly more often, but then have a problem, that i.e. within one method I cannot dispose after a return …

hollow sorrel Oct 28, 2020, 11:17 PM

#

what do you mean?

steady blaze Oct 28, 2020, 11:21 PM

#

nwm, too confused atm

olive kite Oct 29, 2020, 12:18 AM

#

I noticed that in the physics ecs sample project they update their entity translation in FixedStepSimulationSystemGroup. Is it the best place to do updates ? Why do they do it in the step instead of before or after?

steady blaze Oct 29, 2020, 1:29 AM

#

everything works fine without jobs and simple jobs also work fine.
but if it gets a bit more complex, it does not seem to work. maybe NativeList is not usable yet?
Of course I guess I am doing something wrong.
i tried to set all NativeContainers to persistant to be sure. Everything that is created and used inside the job only, i dispose after the job, the others on destroy.
although it says: NullReferenceException: Object reference not set to an instance of an object - where it should set the vertices of the mesh to the results of the Job (NativeList)

#

followed by lots of other errors …

#

Where should/can the NativeLists be initialised? Directly in the declaration of the class? at start/awake of the class?
maybe in the Job? I tried all 3 …
only not yet tried: directly before creating the job …

#

don't think it even starts, very strange …

#

maybe because i am reading from marching cubes lookuptables static values? but they are marked as readonly

hollow sorrel Oct 29, 2020, 1:54 AM

#

they can be initialized anywhere

#

what line throws that error?

#

@olive kite fixedstep systemgroup is basically ecs version of fixedupdate, runs at a fixed time step

steady blaze Oct 29, 2020, 2:06 AM

#

don't get it, also get: InvalidOperationException: Jobs can only create Temp memory
now tried to use always the same value and not use the lookup tables (to avoid static readonly), also changed the vertices, triangles and uvs to be created directly before the job starts (and not with class), no idea …

hollow sorrel Oct 29, 2020, 2:08 AM

#

and you're still getting nullrefs?

#

what line of code?

steady blaze Oct 29, 2020, 2:12 AM

#

null reference is: mesh.vertices = jVertices.ToArray();
maybe i have to sleep and see it a bit clearer tomorrow
I use a regular IJob, i tried IJobParallelFor with a count of 1, then it says:

#

InvalidOperationException: TerrainGenerationJob.vertices is not declared [ReadOnly] in a IJobParallelFor job. The container does not support parallel writing. Please use a more suitable container type.

hollow sorrel Oct 29, 2020, 2:14 AM

#

mesh is the only thing that can be null there

#

you sure you're also creating the mesh first?

steady blaze Oct 29, 2020, 2:16 AM

#

oh yes, really forget to create the mesh 🤦‍♂️

#

that is gone now, still says: InvalidOperationException: Jobs can only create Temp memory

hollow sorrel Oct 29, 2020, 2:17 AM

#

ah

#

either you wanna allocate the nativecontainer first and pass it into your job, or use temp allocator if your job only runs for one frame

#

tho not sure if the one frame restriction applies if it's allocated in a job 🤔

#

oh but since you plan on using it outside the job, yea you gotta allocate it before the job

steady blaze Oct 29, 2020, 2:19 AM

#

ok, maybe something in the job …

#

guess i have to find tomorrow, thx anyway @hollow sorrel !

steady blaze Oct 29, 2020, 2:46 AM

#

i think i don't really get how to allocate and dispose correctly.
when schedule and call the complete immediately after the schedule, I thought Allocator.Temp should be enough, as it cannot render a frame inbetween, but it seems it still needs Allocator.TempJob then.

steady blaze Oct 29, 2020, 3:02 AM

#

ok, set everything to Allocator.Persistent again, also the stuff only needed inside (could take longer when it runs as intended)
and at the end of Execute I dispose all NativeContainers only used in the Job.
also seems not possible/good to initialise a NativeList at declaration, better in Awake or Start, but still get the error:

#

InvalidOperationException: Jobs can only create Temp memory
and then 2 times: A Native Collection has not been disposed, resulting in a memory leak. Enable Full StackTraces to get more details.
But I guess the last ones only because the job does not run

valid haven Oct 29, 2020, 5:35 AM

#

If I want to use dots just for access to Havok Physics. What is the minimum amount of dots integration I need to do. i.e. do I need to use the Hybrid Renderer? Or can I use monobehaviour for everything per normal? What about multiplayer (plan to use MLAPI).

steady blaze Oct 29, 2020, 5:43 AM

#

wow that is really strange now: When I Build the App from my code it just works and runs fine! (much faster as without jobs), but I need to get it running in the editor too. 😢
Maybe really a Unity Bug?

#

what does the error: InvalidOperationException: Jobs can only create Temp memory exactly mean?

#

I now put all in one method to create and schedule und force-finish the job, as well as using the results. (later this should be split, so I start the Job in Update and every LateUpdate I want to check if it is finished.
Maybe anyone has an idea?

#

Looks like this now: ```
NativeList<Vector3> jVertices = new NativeList<Vector3>(Allocator.Persistent);
NativeList<int> jTriangles = new NativeList<int>(Allocator.Persistent);
NativeList<Vector2> jUVs = new NativeList<Vector2>(Allocator.Persistent);
var terraGen = new TerrainGenerationJob()
{
areaSize = areaSize,
isoLevel = isoLevel,
voxelWeight = new NativeArray<float>(voxelWeight, Allocator.Persistent),
points = new NativeArray<Vector3>(points.ToArray(), Allocator.Persistent),
vertices = jVertices,
triangles = jTriangles,
uvs = jUVs
};
var jobHandle = terraGen.Schedule();
jobHandle.Complete();

mesh.vertices = jVertices.ToArray();
mesh.uv = jUVs.ToArray();
mesh.triangles = jTriangles.ToArray();

mesh.RecalculateNormals();
meshFilter.mesh = mesh;
meshCollider.sharedMesh = mesh;

jVertices.Clear();
jTriangles.Clear();
jUVs.Clear();
jVertices.Dispose();
jTriangles.Dispose();
jUVs.Dispose();```

wet epoch Oct 29, 2020, 5:48 AM

#

are you creating something in the job?

#

that's what the error means i think

deft stump Oct 29, 2020, 5:49 AM

#

is it just me. or is the package manager from 2020.1.0b8 and above has a bug.

#

on a fresh reset of a project if resolving packages hits the 2 minute mark, it just errors out

steady blaze Oct 29, 2020, 5:49 AM

#

and the job without content: ```
public struct TerrainGenerationJob : IJob
{
public int3 areaSize;
public float isoLevel;
[DeallocateOnJobCompletion]
public NativeArray<float> voxelWeight;
[DeallocateOnJobCompletion]
public NativeArray<Vector3> points;

public NativeList<Vector3> vertices;
public NativeList<int> triangles;
public NativeList<Vector2> uvs;

public Vector3 interpolateVerts(int p1, int p2, float value0, float value1)
{
    float mu = 0.5f;
    mu = (isoLevel - value0) / (value1 - value0);
    return Vector3.Lerp(points[p1], points[p2], mu);
}

public struct VertexBuffer
{
    public int index, A, B, C, D;
    public VertexBuffer(int i)
    {
        index = i;
        A = -1;
        B = -1;
        C = -1;
        D = -1;
    }
}

public void Execute ()
{
    int areaSizeXY = areaSize.x * areaSize.y;
    Vector3 newVert;
    NativeArray<int> vlist = new NativeArray<int>(12, Allocator.Persistent);
    VertexBuffer lastXBuffer = new VertexBuffer(-1);
    NativeList<VertexBuffer> yBuffer = new NativeList<VertexBuffer>(Allocator.Persistent);
    NativeList<VertexBuffer> zBuffer = new NativeList<VertexBuffer>(Allocator.Persistent);

    // calculations …
    
    vlist.Dispose();
    yBuffer.Dispose();
    zBuffer.Dispose();

    voxelWeight.Dispose();
    points.Dispose();
}

}```

wet epoch Oct 29, 2020, 5:50 AM

#

yeh those arrays need to be Allocator.Temp

steady blaze Oct 29, 2020, 5:50 AM

#

@wet epoch what do you mean with create smth in the job?

wet epoch Oct 29, 2020, 5:50 AM

#

or TempJob? can't remember

steady blaze Oct 29, 2020, 5:51 AM

#

hm, but I dispose them in the end

wet epoch Oct 29, 2020, 5:51 AM

#

yeah, but why are they persistent?

steady blaze Oct 29, 2020, 5:51 AM

#

so it shouldn't heart anything except performance or not?

#

it could take longer than 4 frames for completion

i know compute shader may be even better suited, but harder to learn (and i don't have a code-editor that understands HLSL) thanks a lot @hollow sorrel and @deft stump - i can now image a lot better how to build this from my single-threaded/single-object code.

i know compute shader may be even better suited, but harder to learn (and i don't have a code-editor that understands HLSL)
thanks a lot @hollow sorrel and @deft stump - i can now image a lot better how to build this from my single-threaded/single-object code.